[ 521.914522] env[65885]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.914522] env[65885]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.905030] env[65973]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.905030] env[65973]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.471781] env[65973]: INFO neutron.common.config [-] Logging enabled! [ 524.472209] env[65973]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev20 [ 524.472337] env[65973]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65973) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.472651] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.472780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.473573] env[65973]: WARNING oslo_policy.policy [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.473783] env[65973]: WARNING oslo_policy.policy [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.475475] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] VMware NSXv3 Agent initialized successfully. [ 524.475819] env[65973]: DEBUG oslo_concurrency.lockutils [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Acquiring lock "singleton_lock" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.475944] env[65973]: DEBUG oslo_concurrency.lockutils [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Acquired lock "singleton_lock" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.476154] env[65973]: DEBUG oslo_concurrency.lockutils [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Releasing lock "singleton_lock" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.476466] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Full set of CONF: {{(pid=65973) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.476571] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ******************************************************************************** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.476663] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Configuration options gathered from: {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.477021] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.477192] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.477296] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ================================================================================ {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.477480] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] agent_down_time = 75 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.477621] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] allow_automatic_dhcp_failover = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.477752] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] allow_bulk = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.477889] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] api_extensions_path = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478034] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] api_paste_config = api-paste.ini {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478175] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] auth_strategy = keystone {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478275] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] backdoor_port = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478372] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] backdoor_socket = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478505] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] backlog = 4096 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478636] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478786] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] bind_host = 0.0.0.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.478921] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] bind_port = 9696 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479061] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] client_socket_timeout = 900 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479199] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] config_dir = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479302] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479433] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] config_source = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479592] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] control_exchange = neutron {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479718] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] core_plugin = ml2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479849] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] debug = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.479978] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] default_availability_zones = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480190] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480324] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dhcp_agent_notification = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480454] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dhcp_agents_per_network = 1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480621] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dhcp_lease_duration = 86400 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480771] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dhcp_load_type = networks {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.480905] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dns_domain = openstacklocal {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481051] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481184] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_default_route_bfd = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481305] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_default_route_ecmp = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481427] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_dvr = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481551] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_new_agents = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481676] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481800] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_signals = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.481921] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] enable_traditional_dhcp = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482057] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] external_dns_driver = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482185] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] filter_validation = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482318] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] global_physnet_mtu = 8950 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482446] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] graceful_shutdown_timeout = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482644] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] host = cpu-1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482754] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] host_dvr_for_dhcp = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.482882] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] http_retries = 3 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483024] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] instance_format = [instance: %(uuid)s] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483161] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483297] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ipam_driver = internal {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483427] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ipv6_pd_enabled = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483560] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] l3_ha = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483692] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483825] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] l3_ha_network_physical_name = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.483956] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] l3_ha_network_type = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484104] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_color = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484236] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_config_append = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484382] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484523] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_dir = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484650] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_file = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484751] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_options = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.484884] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_rotate_interval = 1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485032] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_rotate_interval_type = days {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485168] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] log_rotation_type = none {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485271] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485371] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485514] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485637] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485735] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485864] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_dns_nameservers = 5 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.485991] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_header_line = 16384 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486133] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_l3_agents_per_router = 3 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486260] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_logfile_count = 30 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486400] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_logfile_size_mb = 200 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486541] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] max_subnet_host_routes = 20 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486679] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] my_ip = 10.180.1.21 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486825] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] my_ipv6 = ::1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.486939] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] network_auto_schedule = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487074] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] network_link_prefix = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487209] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487344] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] notify_nova_on_port_data_changes = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487515] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] notify_nova_on_port_status_changes = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487657] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] pagination_max_limit = -1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487785] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] publish_errors = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.487912] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rate_limit_burst = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488055] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rate_limit_except_level = CRITICAL {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488183] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rate_limit_interval = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488306] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] retry_until_window = 30 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488431] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] router_distributed = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488557] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rpc_resources_processing_step = 20 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488682] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rpc_response_max_timeout = 600 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488808] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] rpc_response_timeout = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.488932] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] send_events_interval = 2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489086] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] service_plugins = ['router'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489225] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] setproctitle = on {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489348] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] shell_completion = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489478] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] state_path = /opt/stack/data/neutron {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489619] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] syslog_log_facility = LOG_USER {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489748] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] tcp_keepidle = 600 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.489879] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] transport_url = **** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490015] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] use_journal = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490178] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] use_json = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490312] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] use_ssl = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490438] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] use_stderr = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490574] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] use_syslog = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490698] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vlan_qinq = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490844] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vlan_transparent = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.490983] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] watch_log_file = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.491126] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] wsgi_default_pool_size = 100 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.491256] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] wsgi_keep_alive = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.491390] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.491534] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] wsgi_server_debug = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.491741] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_concurrency.disable_process_locking = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.491911] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492071] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492209] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492345] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492480] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492664] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492830] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.connection_string = messaging:// {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.492961] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.enabled = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493111] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.es_doc_type = notification {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493242] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.es_scroll_size = 10000 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493375] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.es_scroll_time = 2m {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493504] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.filter_error_trace = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493638] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.hmac_keys = **** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493771] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.sentinel_service_name = mymaster {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.493912] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.socket_timeout = 0.1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494053] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.trace_requests = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494186] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler.trace_sqlalchemy = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494355] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler_jaeger.process_tags = {} {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494493] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler_jaeger.service_name_prefix = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494626] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] profiler_otlp.service_name_prefix = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.494771] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.enforce_new_defaults = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495057] env[65973]: WARNING oslo_config.cfg [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.495206] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.enforce_scope = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495343] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.policy_default_rule = default {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495486] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495624] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495759] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.495888] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496024] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496177] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496280] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496438] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496591] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496734] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] agent.extensions = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.496869] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497017] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] service_providers.service_provider = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497157] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.default_quota = -1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497295] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497444] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_floatingip = 50 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497581] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_network = 100 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497707] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_port = 500 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497833] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.497958] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_router = 10 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498098] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_security_group = 10 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498228] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498356] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.quota_subnet = 100 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498485] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] QUOTAS.track_quota_usage = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498632] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498764] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.498891] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499028] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499166] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499299] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499428] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499568] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499697] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499823] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.499950] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500092] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500222] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500347] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_dhcp_release.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500484] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500611] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500736] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500864] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.500995] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501137] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501266] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_ovs_vsctl.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501403] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.capabilities = [21] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501529] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501703] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.501891] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502051] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502188] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502318] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_namespace.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502460] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.capabilities = [12] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502591] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502718] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502851] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.502976] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503120] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503257] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_conntrack.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503399] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.capabilities = [12, 21] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503529] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.group = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503656] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.helper_command = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503785] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.log_daemon_traceback = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.503917] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504056] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.thread_pool_size = 8 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504184] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] privsep_link.user = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504368] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504527] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504664] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.continue_on_failed_promotions = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504795] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.dscp = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.504927] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.dscp_inherit = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505077] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.force_mp_to_policy = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505212] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.locking_coordinator_url = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505345] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.log_agent_heartbeats = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505479] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.logging_expire = 1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505619] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505750] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.505887] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.polling_interval = 240 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506027] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506168] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506308] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.report_interval = 30.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506475] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506615] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506752] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.506887] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.sync_skew = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507029] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.synchronization_queue_size = 20 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507167] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT.use_helper_for_ns_read = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507304] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] SECURITYGROUP.enable_ipset = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507460] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] SECURITYGROUP.enable_security_group = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507604] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507744] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.507879] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] experimental.ipv6_pd_enabled = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508037] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.extension_drivers = ['port_security'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508169] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.external_network_type = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508312] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508449] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.overlay_ip_version = 4 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508583] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.path_mtu = 8950 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508717] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.physical_network_mtus = {} {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508857] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.508988] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509139] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ml2.type_drivers = ['vlan'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509278] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509410] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509541] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509681] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509816] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.509948] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510103] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510253] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510391] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510607] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510749] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_login_password = **** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.510889] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511031] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_login_user = admin {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511170] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511308] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511444] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511576] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511712] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511852] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.511987] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512134] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512266] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512402] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512541] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512671] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512804] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.512986] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513153] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513275] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513404] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513541] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.auth_section = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513681] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.auth_type = password {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513815] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.513939] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.certfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514077] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.collect_timing = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514218] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.endpoint_type = public {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514367] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.insecure = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514496] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.keyfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514633] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.region_name = RegionOne {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514761] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.split_loggers = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.514884] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] nova.timeout = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515025] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.auth_section = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515165] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.auth_type = password {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515299] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515425] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.certfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515553] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.collect_timing = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515685] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.endpoint_type = public {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515811] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.insecure = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.515933] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.keyfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516065] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.region_name = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516192] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.split_loggers = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516312] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] placement.timeout = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516466] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.auth_section = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516601] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.auth_type = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516726] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.cafile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516847] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.certfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.516972] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.collect_timing = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517108] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.connect_retries = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517234] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.connect_retry_delay = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517361] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.enable_notifications = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517482] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.endpoint_override = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517609] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.insecure = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517730] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.interface = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.517877] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.keyfile = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518015] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.max_version = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518171] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.min_version = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518369] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.region_name = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518521] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.retriable_status_codes = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518651] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.service_name = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518778] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.service_type = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.518908] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.split_loggers = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519045] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.status_code_retries = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519175] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.status_code_retry_delay = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519301] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.timeout = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519427] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.valid_interfaces = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519552] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ironic.version = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519686] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] cli_script.dry_run = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519827] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.519955] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520095] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520223] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520349] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520477] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520602] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520727] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520854] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.520991] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521131] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521266] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521399] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521535] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521665] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521797] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.521925] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522069] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522208] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522336] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522466] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522596] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522724] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522854] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.522979] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523116] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523266] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523366] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523492] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523615] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523740] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.523873] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524014] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524146] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524290] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524431] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524564] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524703] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_notifications.driver = [] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524836] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_notifications.retry = -1 {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.524984] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.525131] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.525233] env[65973]: DEBUG oslo_service.backend._eventlet.service [None req-37209fd1-ea98-4aa9-bf31-9e05e22ac385 None None] ******************************************************************************** {{(pid=65973) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.526370] env[65973]: DEBUG neutron.agent.securitygroups_rpc [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Init firewall settings (driver=nsxv3) {{(pid=65973) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.527705] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65973) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.527951] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.530267] env[65973]: DEBUG dogpile.cache.region [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.530385] env[65973]: DEBUG dogpile.lock [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.530481] env[65973]: DEBUG dogpile.lock [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.530570] env[65973]: DEBUG dogpile.lock [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.530662] env[65973]: DEBUG dogpile.cache.region [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.530749] env[65973]: DEBUG dogpile.lock [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.530872] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.582381] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Session token - acquiring [ 524.583971] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.584270] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.584389] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.584742] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.596756] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.894103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.916789] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.916978] env[65973]: DEBUG dogpile.cache.region [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Cache value generated in 0.386 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.917041] env[65973]: DEBUG dogpile.lock [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.917171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Activating Policy API Provider. [ 524.917368] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Looking for the default Infrastructure Rules. [ 524.998276] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Looking for the Default Layer3 Logged Drop Section. [ 525.013580] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.013991] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.014175] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.014313] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.014713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.015081] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.530569] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.033385] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.535321] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Inventory metadata is going to be refreshed. [ 526.535713] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.255779] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.256038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.256098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.256390] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.268695] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.269589] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.270245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.290248] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.290526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.290526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.290811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.290935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.291090] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.291202] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.291302] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.312716] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.312949] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.312991] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.313279] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.313449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.313589] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.334409] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.334653] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.334715] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.334981] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.335146] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.335288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.359157] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.359471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.359471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.359731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.359846] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.359968] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.360131] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.360236] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.379830] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.380172] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.380172] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.380395] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.380517] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.380654] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.380755] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.380853] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.408693] env[65973]: DEBUG networking_nsxv3.common.locking [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.408952] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.409134] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.409563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.409787] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.410026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.410195] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.410356] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Inventory metadata have been refreshed. [ 527.410515] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Dryrun:True. Metadata refresh completed. [ 527.410704] env[65973]: DEBUG oslo_concurrency.lockutils [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.413278] env[65973]: INFO neutron.agent.agent_extensions_manager [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Loaded agent extensions: [] [ 527.414382] env[65973]: DEBUG neutron_lib.callbacks.manager [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65973) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.478096] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.478390] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.478507] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent out of sync with plugin! [ 532.415066] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.415463] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.416424] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.416875] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.418424] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.418766] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.453166] env[65973]: INFO networking_nsxv3.common.synchronization [None req-1d81969c-3c80-4983-99ff-69e6b11f2de5 demo admin] Enqueued Resource ID: 1bbe9fb6-1444-4f83-9a47-f50e77da8193 with Priority: HIGHEST for action security_group_rules [ 542.453785] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbe9fb6-1444-4f83-9a47-f50e77da8193 with Priority: HIGHEST for action security_group_rules [ 542.454161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbe9fb6-1444-4f83-9a47-f50e77da8193 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.454291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbe9fb6-1444-4f83-9a47-f50e77da8193" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.454359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbe9fb6-1444-4f83-9a47-f50e77da8193" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.454722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbe9fb6-1444-4f83-9a47-f50e77da8193" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.454811] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbe9fb6-1444-4f83-9a47-f50e77da8193',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.977841] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.978083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.978083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.978264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.978370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.978464] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbe9fb6-1444-4f83-9a47-f50e77da8193 already deleted. [ 542.978550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbe9fb6-1444-4f83-9a47-f50e77da8193" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.454622] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.454990] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.455839] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.456102] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.456449] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.456804] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.459921] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.460294] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.461309] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.461309] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.418403] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.418755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.418755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.418910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.419171] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.921315] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.424023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.928446] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 570.928618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 571.063572] env[65973]: INFO networking_nsxv3.common.synchronization [None req-6961cb08-92b4-4a8d-a1dc-396e651d78c6 None None] Enqueued Resource ID: f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4 with Priority: HIGHEST for action port [ 571.064823] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4 with Priority: HIGHEST for action port [ 571.065821] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.065945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.066034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.066272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.066342] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.570414] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4 [ 571.570720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.570905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.571037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.571373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.571477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.571577] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4 already deleted. [ 571.571660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5aa81d7-5c97-4089-9fd2-d81d98b6a2e4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.654745] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.654745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.654944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.655443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.667140] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 571.669338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.670041] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 571.688630] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.688785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.688850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.689098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.689192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.689300] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 571.689371] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 571.689443] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 571.709518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.709635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.710743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.710743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.710743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.710743] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 571.734554] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.734554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.734554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.735983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.736209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.736291] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 571.757801] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.758327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.758407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.758619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.758728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.758852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 571.758942] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 571.759027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 571.778496] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.778745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.778820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.779106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.779204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.779322] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 571.779400] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 571.779469] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 571.802426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.803571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.803701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.803910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.804030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.804148] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 571.804215] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 571.804282] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 571.804342] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 571.804413] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 571.804471] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 571.804527] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 571.804801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 571.805555] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 571.805646] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 571.829794] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.829938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.830095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.830285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.830432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.830493] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 571.850611] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.850756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.850816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.851027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.851129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.864772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.729132] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e1dcde70-a63b-4a05-b523-156f2b024dd9 None None] Enqueued Resource ID: 6e029de0-c001-4596-a1f3-1d5f24e750bb with Priority: HIGHEST for action port [ 573.729132] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e029de0-c001-4596-a1f3-1d5f24e750bb with Priority: HIGHEST for action port [ 573.729132] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e029de0-c001-4596-a1f3-1d5f24e750bb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.729132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e029de0-c001-4596-a1f3-1d5f24e750bb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.729538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e029de0-c001-4596-a1f3-1d5f24e750bb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.729538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e029de0-c001-4596-a1f3-1d5f24e750bb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.729538] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e029de0-c001-4596-a1f3-1d5f24e750bb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.863577] env[65973]: INFO networking_nsxv3.common.synchronization [None req-05167bd6-63a4-4810-a617-8bdcaf7059eb None None] Enqueued Resource ID: 64ee3452-3649-49f6-86b9-c1d572cc53c5 with Priority: HIGHEST for action port [ 573.865017] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ee3452-3649-49f6-86b9-c1d572cc53c5 with Priority: HIGHEST for action port [ 573.865017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-64ee3452-3649-49f6-86b9-c1d572cc53c5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.865017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64ee3452-3649-49f6-86b9-c1d572cc53c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.865017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64ee3452-3649-49f6-86b9-c1d572cc53c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.865017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64ee3452-3649-49f6-86b9-c1d572cc53c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.866642] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64ee3452-3649-49f6-86b9-c1d572cc53c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.233812] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e029de0-c001-4596-a1f3-1d5f24e750bb [ 574.233812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.233812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.233812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.233812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.233812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.234100] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e029de0-c001-4596-a1f3-1d5f24e750bb already deleted. [ 574.234100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e029de0-c001-4596-a1f3-1d5f24e750bb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.266393] env[65973]: INFO networking_nsxv3.common.synchronization [None req-512143bc-7bbe-4678-a544-ea08125d2699 None None] Enqueued Resource ID: 96c9500d-e430-4ad9-907c-a4254d426b61 with Priority: HIGHEST for action port [ 574.269626] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c9500d-e430-4ad9-907c-a4254d426b61 with Priority: HIGHEST for action port [ 574.270282] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-96c9500d-e430-4ad9-907c-a4254d426b61 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.270282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96c9500d-e430-4ad9-907c-a4254d426b61" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.270282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96c9500d-e430-4ad9-907c-a4254d426b61" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.270467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96c9500d-e430-4ad9-907c-a4254d426b61" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.270499] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c9500d-e430-4ad9-907c-a4254d426b61',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.368816] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64ee3452-3649-49f6-86b9-c1d572cc53c5 [ 574.370523] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.370653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.370703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.370938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.371007] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.371110] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64ee3452-3649-49f6-86b9-c1d572cc53c5 already deleted. [ 574.371196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64ee3452-3649-49f6-86b9-c1d572cc53c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.774957] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96c9500d-e430-4ad9-907c-a4254d426b61 [ 574.774957] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.774957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.774957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.774957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.774957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.774957] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96c9500d-e430-4ad9-907c-a4254d426b61 already deleted. [ 574.774957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96c9500d-e430-4ad9-907c-a4254d426b61" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.753619] env[65973]: INFO networking_nsxv3.common.synchronization [None req-98f6d4f1-b8f4-428e-be3a-00222ac92098 None None] Enqueued Resource ID: 8eeebaa2-3839-42ce-b8fe-645d84096d8d with Priority: HIGHEST for action port [ 575.753822] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eeebaa2-3839-42ce-b8fe-645d84096d8d with Priority: HIGHEST for action port [ 575.754413] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eeebaa2-3839-42ce-b8fe-645d84096d8d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.754565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eeebaa2-3839-42ce-b8fe-645d84096d8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.754621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eeebaa2-3839-42ce-b8fe-645d84096d8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.762020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eeebaa2-3839-42ce-b8fe-645d84096d8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.762020] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eeebaa2-3839-42ce-b8fe-645d84096d8d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.261460] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8eeebaa2-3839-42ce-b8fe-645d84096d8d [ 576.261460] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.261834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.261834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.261920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.261963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.262267] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8eeebaa2-3839-42ce-b8fe-645d84096d8d already deleted. [ 576.262580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eeebaa2-3839-42ce-b8fe-645d84096d8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.468664] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f87a6919-39e6-44cd-8cf4-803dcee85d98 None None] Enqueued Resource ID: 03d7a71c-1ae3-4f68-8610-f2962ae73bce with Priority: HIGHEST for action port [ 576.471436] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7a71c-1ae3-4f68-8610-f2962ae73bce with Priority: HIGHEST for action port [ 576.471436] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-03d7a71c-1ae3-4f68-8610-f2962ae73bce taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.471436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03d7a71c-1ae3-4f68-8610-f2962ae73bce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.471436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03d7a71c-1ae3-4f68-8610-f2962ae73bce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.471436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03d7a71c-1ae3-4f68-8610-f2962ae73bce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.471436] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03d7a71c-1ae3-4f68-8610-f2962ae73bce',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.974808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03d7a71c-1ae3-4f68-8610-f2962ae73bce [ 576.974808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.974808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.974808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.974808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.974808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.974808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03d7a71c-1ae3-4f68-8610-f2962ae73bce already deleted. [ 576.974808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03d7a71c-1ae3-4f68-8610-f2962ae73bce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.978819] env[65973]: INFO networking_nsxv3.common.synchronization [None req-2537d143-c528-4846-8d33-442ecf4fb04d None None] Enqueued Resource ID: 761ae4e6-374a-45b9-bf6f-9545f3f45b9e with Priority: HIGHEST for action port [ 578.979623] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761ae4e6-374a-45b9-bf6f-9545f3f45b9e with Priority: HIGHEST for action port [ 578.980677] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-761ae4e6-374a-45b9-bf6f-9545f3f45b9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.980677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761ae4e6-374a-45b9-bf6f-9545f3f45b9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.980677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761ae4e6-374a-45b9-bf6f-9545f3f45b9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.980677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761ae4e6-374a-45b9-bf6f-9545f3f45b9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.980677] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761ae4e6-374a-45b9-bf6f-9545f3f45b9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.987696] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a60414e9-1637-41b8-8e32-1b764e85a15e None None] Enqueued Resource ID: f5994419-b4f4-43e9-8bd5-21a3b7a3499d with Priority: HIGHEST for action port [ 578.988498] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5994419-b4f4-43e9-8bd5-21a3b7a3499d with Priority: HIGHEST for action port [ 578.988498] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5994419-b4f4-43e9-8bd5-21a3b7a3499d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.988651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5994419-b4f4-43e9-8bd5-21a3b7a3499d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.988651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5994419-b4f4-43e9-8bd5-21a3b7a3499d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.988892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5994419-b4f4-43e9-8bd5-21a3b7a3499d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.989137] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5994419-b4f4-43e9-8bd5-21a3b7a3499d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.484990] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761ae4e6-374a-45b9-bf6f-9545f3f45b9e [ 579.485360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.485513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.485597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.485828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.485920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.486036] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761ae4e6-374a-45b9-bf6f-9545f3f45b9e already deleted. [ 579.486271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761ae4e6-374a-45b9-bf6f-9545f3f45b9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.492847] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5994419-b4f4-43e9-8bd5-21a3b7a3499d [ 579.494801] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.494801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.494801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.494801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.494801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.494801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5994419-b4f4-43e9-8bd5-21a3b7a3499d already deleted. [ 579.494801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5994419-b4f4-43e9-8bd5-21a3b7a3499d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.208695] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5767d762-2dc1-4829-a8be-a48f7bf16962 None None] Enqueued Resource ID: 94c75f70-0739-4bc9-b652-7cad0a015818 with Priority: HIGHEST for action port [ 580.208695] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c75f70-0739-4bc9-b652-7cad0a015818 with Priority: HIGHEST for action port [ 580.209132] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c75f70-0739-4bc9-b652-7cad0a015818 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.209132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c75f70-0739-4bc9-b652-7cad0a015818" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.209132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c75f70-0739-4bc9-b652-7cad0a015818" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.209350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c75f70-0739-4bc9-b652-7cad0a015818" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.209492] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c75f70-0739-4bc9-b652-7cad0a015818',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.229283] env[65973]: INFO networking_nsxv3.common.synchronization [req-3d35654d-dce4-4b14-a782-b0934e0cdbc1 req-e2666516-983a-4fe6-b3c4-e280dda15cc7 tempest-ServerDiagnosticsNegativeTest-71583505 tempest-ServerDiagnosticsNegativeTest-71583505-project-member] Enqueued Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 580.231364] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 580.231364] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.231364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.231364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.235279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.235279] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.235279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.235279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.235279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.235279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.235279] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.711804] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94c75f70-0739-4bc9-b652-7cad0a015818 [ 580.711804] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.711804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.711804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.711804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.712145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.712145] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94c75f70-0739-4bc9-b652-7cad0a015818 already deleted. [ 580.712145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c75f70-0739-4bc9-b652-7cad0a015818" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.734272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.735174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.735285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.735794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.735794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.736126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.736303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.736379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.736707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.736707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.736861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c already deleted. [ 580.736861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.824960] env[65973]: INFO networking_nsxv3.common.synchronization [None req-dc0e72d5-d987-4636-9631-260d56fabfa7 None None] Enqueued Resource ID: 993e428f-3cab-449b-925e-f8caca372828 with Priority: HIGHEST for action port [ 580.825510] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993e428f-3cab-449b-925e-f8caca372828 with Priority: HIGHEST for action port [ 580.825880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-993e428f-3cab-449b-925e-f8caca372828 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.825998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993e428f-3cab-449b-925e-f8caca372828" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.826072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993e428f-3cab-449b-925e-f8caca372828" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.826490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993e428f-3cab-449b-925e-f8caca372828" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.826490] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993e428f-3cab-449b-925e-f8caca372828',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.329677] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 993e428f-3cab-449b-925e-f8caca372828 [ 581.329948] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.330038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.330141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.331032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.331032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.331032] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:993e428f-3cab-449b-925e-f8caca372828 already deleted. [ 581.331032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993e428f-3cab-449b-925e-f8caca372828" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.353753] env[65973]: INFO networking_nsxv3.common.synchronization [None req-30cd55aa-a035-444f-99e0-caaf5f272d2a None None] Enqueued Resource ID: 77c10cd9-f0a4-498d-9691-f8f581754d3b with Priority: HIGHEST for action port [ 581.353753] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77c10cd9-f0a4-498d-9691-f8f581754d3b with Priority: HIGHEST for action port [ 581.356154] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-77c10cd9-f0a4-498d-9691-f8f581754d3b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.356154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77c10cd9-f0a4-498d-9691-f8f581754d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.356154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77c10cd9-f0a4-498d-9691-f8f581754d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.357047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77c10cd9-f0a4-498d-9691-f8f581754d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.357330] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77c10cd9-f0a4-498d-9691-f8f581754d3b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.515374] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.515573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.515690] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.515971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.516376] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.516542] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.516655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.516872] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.517017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.517358] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.517488] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 581.517624] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 581.517712] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 581.517811] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.518541] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 581.519465] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 581.541228] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 581.541228] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 581.541348] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 581.541526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.541808] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-107502c2-d056-4c36-ba1b-e6bf2177345f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.542336] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.542336] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.542462] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.542517] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107502c2-d056-4c36-ba1b-e6bf2177345f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.860629] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77c10cd9-f0a4-498d-9691-f8f581754d3b [ 581.862422] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.862567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.862639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.862859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.862951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.863062] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77c10cd9-f0a4-498d-9691-f8f581754d3b already deleted. [ 581.863150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77c10cd9-f0a4-498d-9691-f8f581754d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.049132] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.049132] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 107502c2-d056-4c36-ba1b-e6bf2177345f not found, creating... [ 582.049132] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.049132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.050070] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.050423] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.050680] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.051017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.051391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.051807] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 107502c2-d056-4c36-ba1b-e6bf2177345f is going to be created. [ 582.077696] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.077696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.077696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.077696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.077696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.077696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.234410] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f61bf558-f146-4ebf-bb15-81cd8ac69d34 None None] Enqueued Resource ID: 2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5 with Priority: HIGHEST for action port [ 582.234702] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5 with Priority: HIGHEST for action port [ 582.235628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.235752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.235819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.236336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.236459] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.467825] env[65973]: INFO networking_nsxv3.common.synchronization [req-8ca820c4-8935-4d46-85ac-64a25f65a500 req-3589b99f-7419-4743-9e22-a9c368025147 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 582.468356] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 582.468808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.468808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.468935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.469095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.469229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.469329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.469391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.469542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.469619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.469725] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.731070] env[65973]: INFO networking_nsxv3.common.synchronization [None req-58d1af9b-5cc7-48ef-9fec-8de4c1cdade7 None None] Enqueued Resource ID: 74a2bf44-c840-4f67-9d06-492506037d3b with Priority: HIGHEST for action port [ 582.731578] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a2bf44-c840-4f67-9d06-492506037d3b with Priority: HIGHEST for action port [ 582.732717] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a2bf44-c840-4f67-9d06-492506037d3b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.732717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a2bf44-c840-4f67-9d06-492506037d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.732717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a2bf44-c840-4f67-9d06-492506037d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.732717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a2bf44-c840-4f67-9d06-492506037d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.732717] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a2bf44-c840-4f67-9d06-492506037d3b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.739649] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5 [ 582.739744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.739851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.739919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.740157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.740211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.740299] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5 already deleted. [ 582.740374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c165d5e-f9eb-4e38-8bfd-99d59c85f3b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.863656] env[65973]: INFO networking_nsxv3.common.synchronization [req-3d35654d-dce4-4b14-a782-b0934e0cdbc1 req-231adb56-9db1-4d22-b45c-2734b963283f service nova] Enqueued Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_rules [ 582.863827] env[65973]: INFO networking_nsxv3.common.synchronization [req-3d35654d-dce4-4b14-a782-b0934e0cdbc1 req-231adb56-9db1-4d22-b45c-2734b963283f service nova] Enqueued Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 582.863955] env[65973]: INFO networking_nsxv3.common.synchronization [req-3d35654d-dce4-4b14-a782-b0934e0cdbc1 req-231adb56-9db1-4d22-b45c-2734b963283f service nova] Enqueued Resource ID: 107502c2-d056-4c36-ba1b-e6bf2177345f with Priority: HIGHEST for action port [ 582.864238] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_rules [ 582.864321] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 582.864420] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107502c2-d056-4c36-ba1b-e6bf2177345f with Priority: HIGHEST for action port [ 582.864954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.865363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.865465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.865731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.865860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.866726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.867080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.867190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.867420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.867610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.867762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.869049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.869257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.869384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.869506] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.870655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-107502c2-d056-4c36-ba1b-e6bf2177345f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.871374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.871584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.871841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.872320] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107502c2-d056-4c36-ba1b-e6bf2177345f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.972486] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.972655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.972703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.973564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.973564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.973799] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee already deleted. [ 582.973799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.239210] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74a2bf44-c840-4f67-9d06-492506037d3b [ 583.239210] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.239210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.239210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.239210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.239210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.239210] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74a2bf44-c840-4f67-9d06-492506037d3b already deleted. [ 583.239210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a2bf44-c840-4f67-9d06-492506037d3b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.374784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.374986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.387044] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.388691] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 107502c2-d056-4c36-ba1b-e6bf2177345f with status ACTIVE [ 583.388957] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.389285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.389391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.389655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.390327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.390327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.390327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.390327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.390327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.390578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.390796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.390796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.390936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.391615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.391615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.391615] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 107502c2-d056-4c36-ba1b-e6bf2177345f is going to be updated. [ 583.414026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.414026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.414026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.414313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.414725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.414725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107502c2-d056-4c36-ba1b-e6bf2177345f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.714615] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.715025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.715025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.715291] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.715550] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.715703] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.715808] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.718506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.718762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.719211] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.719283] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.719710] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.719898] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.720222] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.720355] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.720548] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.752451] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.752619] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.752754] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.752931] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.753266] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.753437] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.753552] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.753872] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.754015] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f15b6b6-ba07-4bf7-a8d8-a111535ab31b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.894870] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.931588] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a203843e-dd6d-4d7d-8802-8d6f11f21fa4 None None] Enqueued Resource ID: 62ee1eee-c310-4d02-ab19-3ff717379343 with Priority: HIGHEST for action port [ 583.931702] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ee1eee-c310-4d02-ab19-3ff717379343 with Priority: HIGHEST for action port [ 583.932144] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-62ee1eee-c310-4d02-ab19-3ff717379343 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.932270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62ee1eee-c310-4d02-ab19-3ff717379343" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.932340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62ee1eee-c310-4d02-ab19-3ff717379343" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.932634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62ee1eee-c310-4d02-ab19-3ff717379343" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.932680] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ee1eee-c310-4d02-ab19-3ff717379343',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.259188] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.259915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.262180] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.262431] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.262608] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.263611] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b not found, creating... [ 584.263611] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.263611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.263611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.263611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.263853] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.263944] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.264156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.264483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.264483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.264600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.264732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b is going to be created. [ 584.286238] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.286470] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.286596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.286865] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.287098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.287327] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.397446] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.398941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.398941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.398941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.398941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.398941] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c is going to be created. [ 584.431515] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.431741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.431829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.432212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.432306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.434909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62ee1eee-c310-4d02-ab19-3ff717379343 [ 584.435164] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.435318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.435409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.435610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.435722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.435832] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62ee1eee-c310-4d02-ab19-3ff717379343 already deleted. [ 584.436036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62ee1eee-c310-4d02-ab19-3ff717379343" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.440986] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: UNINITIALIZED for 2s [ 585.069398] env[65973]: INFO networking_nsxv3.common.synchronization [req-8ca820c4-8935-4d46-85ac-64a25f65a500 req-30b17a8c-2e27-41b7-a2de-92d91074752b service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 585.069398] env[65973]: INFO networking_nsxv3.common.synchronization [req-8ca820c4-8935-4d46-85ac-64a25f65a500 req-30b17a8c-2e27-41b7-a2de-92d91074752b service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 585.069694] env[65973]: INFO networking_nsxv3.common.synchronization [req-8ca820c4-8935-4d46-85ac-64a25f65a500 req-30b17a8c-2e27-41b7-a2de-92d91074752b service nova] Enqueued Resource ID: 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b with Priority: HIGHEST for action port [ 585.070126] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 585.070738] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 585.070853] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b with Priority: HIGHEST for action port [ 585.071143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.071435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.071534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.071757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.071837] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.073133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.073269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.073338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.073511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.073662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.073757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.073821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.073962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.074061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.074833] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.077491] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.077620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.077691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.077858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.077953] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f15b6b6-ba07-4bf7-a8d8-a111535ab31b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.574344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.574344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.580126] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.586210] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b with status ACTIVE [ 585.586210] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.586210] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.586210] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.586210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.586210] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f15b6b6-ba07-4bf7-a8d8-a111535ab31b is going to be updated. [ 585.609870] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.610047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.610140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.610289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.610417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.610597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f15b6b6-ba07-4bf7-a8d8-a111535ab31b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.631494] env[65973]: INFO networking_nsxv3.common.synchronization [None req-183f36cb-8222-4579-8231-416083ec4f59 None None] Enqueued Resource ID: 1f1dedb1-9d16-4b54-a2a4-ae721cf9d374 with Priority: HIGHEST for action port [ 585.631494] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f1dedb1-9d16-4b54-a2a4-ae721cf9d374 with Priority: HIGHEST for action port [ 585.631792] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f1dedb1-9d16-4b54-a2a4-ae721cf9d374 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.632034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f1dedb1-9d16-4b54-a2a4-ae721cf9d374" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.632118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f1dedb1-9d16-4b54-a2a4-ae721cf9d374" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.632358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f1dedb1-9d16-4b54-a2a4-ae721cf9d374" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.632434] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f1dedb1-9d16-4b54-a2a4-ae721cf9d374',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.968878] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a8901aa2-3375-4087-b0ed-dadb97c67350 None None] Enqueued Resource ID: ca8783f7-a204-474a-9e95-55a5fe0c6344 with Priority: HIGHEST for action port [ 585.968878] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8783f7-a204-474a-9e95-55a5fe0c6344 with Priority: HIGHEST for action port [ 585.968878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca8783f7-a204-474a-9e95-55a5fe0c6344 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.968878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca8783f7-a204-474a-9e95-55a5fe0c6344" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.968878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca8783f7-a204-474a-9e95-55a5fe0c6344" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.969193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca8783f7-a204-474a-9e95-55a5fe0c6344" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.969362] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca8783f7-a204-474a-9e95-55a5fe0c6344',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.082801] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.136770] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f1dedb1-9d16-4b54-a2a4-ae721cf9d374 [ 586.136770] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.136770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.136770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.136770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.136770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.136770] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f1dedb1-9d16-4b54-a2a4-ae721cf9d374 already deleted. [ 586.136770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f1dedb1-9d16-4b54-a2a4-ae721cf9d374" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.453533] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: SUCCESS [ 586.453795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.453964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.454236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.454386] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.454519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.454565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.454979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.454979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.454979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.454979] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.473133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca8783f7-a204-474a-9e95-55a5fe0c6344 [ 586.473133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.473480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.473480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.473480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.473752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.473752] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca8783f7-a204-474a-9e95-55a5fe0c6344 already deleted. [ 586.473752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca8783f7-a204-474a-9e95-55a5fe0c6344" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.586994] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.586994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.586994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.586994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.586994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.587406] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be created. [ 586.611811] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.611982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.612062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.612276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.612453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.624785] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: UNINITIALIZED for 2s [ 586.960845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.960958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.961042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.961258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.961551] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.961667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.961753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.962062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.962256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.962575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.962575] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.962719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.962719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.963379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.963379] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.963379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.963379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.963379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.963379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.963677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.963677] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.966675] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ab3beb11-29e2-4cae-b867-2fd80d4fa76c None None] Enqueued Resource ID: 70173388-fbc3-4b00-b3c9-d595e5af1ae2 with Priority: HIGHEST for action port [ 586.967748] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70173388-fbc3-4b00-b3c9-d595e5af1ae2 with Priority: HIGHEST for action port [ 586.968123] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-70173388-fbc3-4b00-b3c9-d595e5af1ae2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.968303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70173388-fbc3-4b00-b3c9-d595e5af1ae2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.968415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70173388-fbc3-4b00-b3c9-d595e5af1ae2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.968760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70173388-fbc3-4b00-b3c9-d595e5af1ae2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.968760] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70173388-fbc3-4b00-b3c9-d595e5af1ae2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.467037] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23be5268-bae9-4d02-addf-8da8a520e87c: rpc.has_security_group_logging(os_id): False [ 587.473448] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70173388-fbc3-4b00-b3c9-d595e5af1ae2 [ 587.474121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.474121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.474121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.474121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.474330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.474330] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70173388-fbc3-4b00-b3c9-d595e5af1ae2 already deleted. [ 587.474385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70173388-fbc3-4b00-b3c9-d595e5af1ae2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.488296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.488839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.488839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.488839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.488839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.489485] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.489485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.489485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.489485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.489485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.489485] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.491883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.491883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.492181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.494026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.494026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c is going to be created. [ 587.557832] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.557998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.558079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.558400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.558559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.571838] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: IN_PROGRESS for 2s [ 588.413269] env[65973]: INFO networking_nsxv3.common.synchronization [req-d4397d1d-5a69-4dfd-9500-fe3690b061b0 req-459ad5f3-20fa-4fe1-a7db-bda8c2587a4f tempest-TenantUsagesTestJSON-444332243 tempest-TenantUsagesTestJSON-444332243-project-member] Enqueued Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 588.414130] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 588.414130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.414689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.414769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.415100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.415203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.415336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.416235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.416235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.416235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.416235] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.636115] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 588.636500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.636500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.636690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.636878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.636999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.637064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.637233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.637436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.637436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.637551] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.696586] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.696586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.696734] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.697557] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.697557] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.697557] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.697557] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.697776] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.697854] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.698052] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.698158] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.698291] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.698372] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.698453] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.698549] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.698682] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.717250] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.717509] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.717648] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.717998] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.718355] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-e5d98d38-c2e0-4063-a6a0-d6a45d978304 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.718527] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.718672] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.719425] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.719564] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d98d38-c2e0-4063-a6a0-d6a45d978304',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.923139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.923139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.923139] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb already deleted. [ 588.923139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.140287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.140464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.140537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.140770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.140938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.141055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.141120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.141278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.141365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.141451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.141598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.141702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.141785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.141935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.142086] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.142177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.142236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.142375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.142453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.142535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.142626] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.222446] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.222804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.222980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.223295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.223442] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.223591] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port e5d98d38-c2e0-4063-a6a0-d6a45d978304 not found, creating... [ 589.223857] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.224019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.224131] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.224356] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.224580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.224733] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.224899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.225493] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.225756] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.225858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.225993] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: e5d98d38-c2e0-4063-a6a0-d6a45d978304 is going to be created. [ 589.246906] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.247592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.247805] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.248327] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.248635] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.249188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.552268] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5e790053-0c03-4a4f-b8dd-57f6aec98319 tempest-VolumesAssistedSnapshotsTest-1512252783 tempest-VolumesAssistedSnapshotsTest-1512252783-project-member] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 589.552806] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 589.553146] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.553252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.554566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.554566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.554566] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.583351] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: SUCCESS [ 589.583351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.604534] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f102ec05-11b0-43c7-8224-d90ae092b3fd None None] Enqueued Resource ID: f1bb3419-d54e-4ca2-b841-f7ef204223a9 with Priority: HIGHEST for action port [ 589.605030] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1bb3419-d54e-4ca2-b841-f7ef204223a9 with Priority: HIGHEST for action port [ 589.605288] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1bb3419-d54e-4ca2-b841-f7ef204223a9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.605431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1bb3419-d54e-4ca2-b841-f7ef204223a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.605499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1bb3419-d54e-4ca2-b841-f7ef204223a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.605763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1bb3419-d54e-4ca2-b841-f7ef204223a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.605846] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1bb3419-d54e-4ca2-b841-f7ef204223a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.645175] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab67debe-f546-499b-8301-c37179fecdee: rpc.has_security_group_logging(os_id): False [ 589.664042] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.664161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.664279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.664529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.664686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.664747] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.664830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.664889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.665077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.665173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.665678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.665678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.665678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.665678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.665678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.665959] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.665959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.666073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.666164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.666236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.666317] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be created. [ 589.723835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.724015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.724104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.724409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.724409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.735717] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 589.820093] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9398119c-f7a3-4b82-ac15-3e96c84dd686 tempest-VolumesAssistedSnapshotsTest-1512252783 tempest-VolumesAssistedSnapshotsTest-1512252783-project-member] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 589.821302] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 589.821302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.821421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.924647] env[65973]: INFO networking_nsxv3.common.synchronization [req-8c294cb6-5aea-4ac0-9397-03ca432f06dc req-17bab5a4-479b-431e-b028-6de09a4d6142 tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: ef5634a5-cf43-4155-a648-c4003423458c with Priority: HIGHEST for action security_group_rules [ 589.924993] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5634a5-cf43-4155-a648-c4003423458c with Priority: HIGHEST for action security_group_rules [ 589.926419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5634a5-cf43-4155-a648-c4003423458c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.926606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5634a5-cf43-4155-a648-c4003423458c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.926707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5634a5-cf43-4155-a648-c4003423458c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.927847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5634a5-cf43-4155-a648-c4003423458c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.927938] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5634a5-cf43-4155-a648-c4003423458c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.011093] env[65973]: INFO networking_nsxv3.common.synchronization [req-d4397d1d-5a69-4dfd-9500-fe3690b061b0 req-7caba2da-2b01-4272-a533-7cdd59b44cc3 service nova] Enqueued Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_rules [ 590.011285] env[65973]: INFO networking_nsxv3.common.synchronization [req-d4397d1d-5a69-4dfd-9500-fe3690b061b0 req-7caba2da-2b01-4272-a533-7cdd59b44cc3 service nova] Enqueued Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 590.011437] env[65973]: INFO networking_nsxv3.common.synchronization [req-d4397d1d-5a69-4dfd-9500-fe3690b061b0 req-7caba2da-2b01-4272-a533-7cdd59b44cc3 service nova] Enqueued Resource ID: e5d98d38-c2e0-4063-a6a0-d6a45d978304 with Priority: HIGHEST for action port [ 590.012330] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_rules [ 590.012451] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 590.013090] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d98d38-c2e0-4063-a6a0-d6a45d978304 with Priority: HIGHEST for action port [ 590.013090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.013090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.013090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.013679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.013679] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.016334] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.016999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.016999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.016999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.016999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.016999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.017583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.017583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.017583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.017678] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.019172] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d98d38-c2e0-4063-a6a0-d6a45d978304 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.019172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.019971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.020506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.020506] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d98d38-c2e0-4063-a6a0-d6a45d978304',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.076155] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.076312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.076383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.076568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.076669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.076764] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa already deleted. [ 590.076846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.076994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.077175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.077257] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.107531] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1bb3419-d54e-4ca2-b841-f7ef204223a9 [ 590.107688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.107757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.107822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.108074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.108163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.108316] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1bb3419-d54e-4ca2-b841-f7ef204223a9 already deleted. [ 590.108405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1bb3419-d54e-4ca2-b841-f7ef204223a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.458442] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.458514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.459131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.459131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.459131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.459131] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5634a5-cf43-4155-a648-c4003423458c already deleted. [ 590.459366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5634a5-cf43-4155-a648-c4003423458c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.521373] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.522531] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.522642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.527104] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5d98d38-c2e0-4063-a6a0-d6a45d978304 with status ACTIVE [ 590.527104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.527104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.527104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.527104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.527104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.528360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.528749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.528749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.528749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.529074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.529074] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.529255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.529255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.529340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.529389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.529576] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5d98d38-c2e0-4063-a6a0-d6a45d978304 is going to be updated. [ 590.564461] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.564629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.564703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.565363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.565851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.565938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d98d38-c2e0-4063-a6a0-d6a45d978304" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.599840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.600043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.600809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.600809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.600809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.600809] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa already deleted. [ 590.600809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.961761] env[65973]: INFO networking_nsxv3.common.synchronization [req-80236a0c-08ca-478e-a87b-5130f280ccf1 req-becf3ab1-08d1-402c-a7b6-12058a99b853 tempest-ServerDiagnosticsTest-486114040 tempest-ServerDiagnosticsTest-486114040-project-member] Enqueued Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 590.962495] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 590.962975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.963093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.963213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.963469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.963633] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.963736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.963863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.963976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.965323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.965734] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.025179] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.293980] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.293980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.293980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.294360] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.294776] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.294923] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.295042] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.295415] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.295559] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.295846] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.296034] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.296201] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.296410] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.296603] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.296773] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.296942] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.318046] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.318237] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.318417] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.318623] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.318983] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-ab03c23e-1ff2-48ae-8286-dda73616b2f8 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.319200] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.319346] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.319692] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.319850] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab03c23e-1ff2-48ae-8286-dda73616b2f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.473840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.474058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.474122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.474294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.474388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.474580] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.474836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.474836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.474961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.474961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.475033] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 already deleted. [ 591.475107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.527459] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.527799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.528039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.528384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.528499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.528625] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb is going to be created. [ 591.553412] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.553576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.553644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.553839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.554042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.565343] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: UNINITIALIZED for 2s [ 591.760573] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 591.760863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.822310] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.822522] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.822639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.823056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.823160] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.823230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port ab03c23e-1ff2-48ae-8286-dda73616b2f8 not found, creating... [ 591.823536] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.823674] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.823799] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.824046] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.824137] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.824427] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.824549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.824653] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.824925] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.825133] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.825133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: ab03c23e-1ff2-48ae-8286-dda73616b2f8 is going to be created. [ 591.859769] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.860079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.860254] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.860651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.860961] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.861800] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.479224] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c0b2a1fa-ccc6-48c6-99d9-3df8a3cb31d3 None None] Enqueued Resource ID: aa09bb73-2dd3-4188-b1ba-6840d516ace7 with Priority: HIGHEST for action port [ 592.479854] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa09bb73-2dd3-4188-b1ba-6840d516ace7 with Priority: HIGHEST for action port [ 592.480428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa09bb73-2dd3-4188-b1ba-6840d516ace7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.480584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa09bb73-2dd3-4188-b1ba-6840d516ace7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.480655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa09bb73-2dd3-4188-b1ba-6840d516ace7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.480912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa09bb73-2dd3-4188-b1ba-6840d516ace7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.481043] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa09bb73-2dd3-4188-b1ba-6840d516ace7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.558216] env[65973]: INFO networking_nsxv3.common.synchronization [req-80236a0c-08ca-478e-a87b-5130f280ccf1 req-8570c9a7-0180-4b2e-b3fb-bd66d634ef2b service nova] Enqueued Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_rules [ 592.558464] env[65973]: INFO networking_nsxv3.common.synchronization [req-80236a0c-08ca-478e-a87b-5130f280ccf1 req-8570c9a7-0180-4b2e-b3fb-bd66d634ef2b service nova] Enqueued Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 592.558640] env[65973]: INFO networking_nsxv3.common.synchronization [req-80236a0c-08ca-478e-a87b-5130f280ccf1 req-8570c9a7-0180-4b2e-b3fb-bd66d634ef2b service nova] Enqueued Resource ID: ab03c23e-1ff2-48ae-8286-dda73616b2f8 with Priority: HIGHEST for action port [ 592.561394] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_rules [ 592.561671] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 592.561825] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab03c23e-1ff2-48ae-8286-dda73616b2f8 with Priority: HIGHEST for action port [ 592.563630] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.563630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.563630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.563630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.563630] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.563929] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.564069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.564210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.564438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.564589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.564693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.564822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.564955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.565299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.565407] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.566384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab03c23e-1ff2-48ae-8286-dda73616b2f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.567032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.567130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.567837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.567926] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab03c23e-1ff2-48ae-8286-dda73616b2f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.983507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa09bb73-2dd3-4188-b1ba-6840d516ace7 [ 592.983714] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.983845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.983913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.984161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.984244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.984337] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa09bb73-2dd3-4188-b1ba-6840d516ace7 already deleted. [ 592.984430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa09bb73-2dd3-4188-b1ba-6840d516ace7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.071732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.071895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.072171] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.073130] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab03c23e-1ff2-48ae-8286-dda73616b2f8 with status ACTIVE [ 593.073371] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.073454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.073544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.073755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.073870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.074089] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.074209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.074350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.074566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.074708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.074851] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.075096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.075096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.075179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.075408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.075408] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab03c23e-1ff2-48ae-8286-dda73616b2f8 is going to be updated. [ 593.099826] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.100048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.100048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.100261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.100395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.100584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab03c23e-1ff2-48ae-8286-dda73616b2f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.278283] env[65973]: INFO networking_nsxv3.common.synchronization [req-3022d92d-3893-4c11-b0ec-e5b2bac35e3d req-efb2b51e-549f-4add-ac71-30c019078be1 tempest-ServerExternalEventsTest-1621717240 tempest-ServerExternalEventsTest-1621717240-project-member] Enqueued Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 593.278480] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 593.278726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.278855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.278921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.279197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.279354] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.279454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.279513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.279670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.280486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.280486] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.579461] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: SUCCESS [ 593.579461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.579461] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.580310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.580532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.582383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.582383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.582383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.582383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.582383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.583173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.583173] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.638185] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.638185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.638185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.638185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.638185] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.638185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.638185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.638494] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.638581] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.639310] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.639310] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.639310] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.639310] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.639495] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.641493] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.641691] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.663948] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.663948] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.663948] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.664190] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.664415] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-fa673c14-61bd-4356-b603-0ea90b790f59 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.664706] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.664839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.665165] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.665324] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa673c14-61bd-4356-b603-0ea90b790f59',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.782669] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.782826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.782900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.783169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.783265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.783504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.783601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.783686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.783833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.783912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.784034] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe already deleted. [ 593.784151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.087850] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.088079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.088079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.088289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.088388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.088501] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 is going to be created. [ 594.090153] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.090315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.090362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.090515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.090713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.090807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.090863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.091090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.091168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.091252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.091397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.091491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.091550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.091695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.091848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.091936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.091995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.092174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.092250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.092417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.092417] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.118253] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.118505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.118505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.119000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.119180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.130236] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: UNINITIALIZED for 2s [ 594.168434] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.168719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.168907] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.169213] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.169356] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.169504] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port fa673c14-61bd-4356-b603-0ea90b790f59 not found, creating... [ 594.169785] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.169946] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.170066] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.170289] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.170423] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.170871] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.170871] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.171070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.171164] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.171334] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.171484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: fa673c14-61bd-4356-b603-0ea90b790f59 is going to be created. [ 594.195790] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.198019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.198019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.198019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.198019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.198019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.595574] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dcf9f05-2312-463f-a10f-331dffd06aeb: rpc.has_security_group_logging(os_id): False [ 594.621391] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.621642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.621701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.621943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.622097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.622416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.622533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.622591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.622792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.622869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.623290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.623492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.623492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.623667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.623739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.623997] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.624165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.624259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.624492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.624792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.624889] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb is going to be created. [ 594.693729] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.693729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.693729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.693729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.693729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.715617] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: IN_PROGRESS for 2s [ 594.937173] env[65973]: INFO networking_nsxv3.common.synchronization [req-3022d92d-3893-4c11-b0ec-e5b2bac35e3d req-1ef8ab35-f9d3-4db1-b5f1-2cae4e7d7efa service nova] Enqueued Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_rules [ 594.937431] env[65973]: INFO networking_nsxv3.common.synchronization [req-3022d92d-3893-4c11-b0ec-e5b2bac35e3d req-1ef8ab35-f9d3-4db1-b5f1-2cae4e7d7efa service nova] Enqueued Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 594.937534] env[65973]: INFO networking_nsxv3.common.synchronization [req-3022d92d-3893-4c11-b0ec-e5b2bac35e3d req-1ef8ab35-f9d3-4db1-b5f1-2cae4e7d7efa service nova] Enqueued Resource ID: fa673c14-61bd-4356-b603-0ea90b790f59 with Priority: HIGHEST for action port [ 594.938244] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_rules [ 594.938244] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 594.938359] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa673c14-61bd-4356-b603-0ea90b790f59 with Priority: HIGHEST for action port [ 594.938541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.938661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.938723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.943067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.943067] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.943737] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.943858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.943919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.944126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.944285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.944390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.944462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.944591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.944976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.944976] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.947894] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa673c14-61bd-4356-b603-0ea90b790f59 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.947894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.947894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.947894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.947894] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa673c14-61bd-4356-b603-0ea90b790f59',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.073023] env[65973]: INFO networking_nsxv3.common.synchronization [None req-0a9d6d16-90a6-4381-98fb-6da784703b05 None None] Enqueued Resource ID: c003e299-b134-40c0-a7ab-66110c32a5e5 with Priority: HIGHEST for action port [ 595.073023] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003e299-b134-40c0-a7ab-66110c32a5e5 with Priority: HIGHEST for action port [ 595.074375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c003e299-b134-40c0-a7ab-66110c32a5e5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.074375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c003e299-b134-40c0-a7ab-66110c32a5e5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.074375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c003e299-b134-40c0-a7ab-66110c32a5e5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.074375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c003e299-b134-40c0-a7ab-66110c32a5e5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.077518] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c003e299-b134-40c0-a7ab-66110c32a5e5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.448206] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.449775] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.449933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.452046] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa673c14-61bd-4356-b603-0ea90b790f59 with status ACTIVE [ 595.453607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.453607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.453607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.453607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.454095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.454095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.454095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.454095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.454095] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa673c14-61bd-4356-b603-0ea90b790f59 is going to be updated. [ 595.503706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.503839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.503964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.504323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.504547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.504893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa673c14-61bd-4356-b603-0ea90b790f59" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.581018] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c003e299-b134-40c0-a7ab-66110c32a5e5 [ 595.581018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.581493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.581493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.581493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.581493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.582069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c003e299-b134-40c0-a7ab-66110c32a5e5 already deleted. [ 595.582069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c003e299-b134-40c0-a7ab-66110c32a5e5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.861400] env[65973]: INFO networking_nsxv3.common.synchronization [req-9cce22c4-4b4e-432d-bac1-37c5172733d9 req-41552ffb-0305-40c0-a41f-a52bedb07c3c tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: 6c41f7cd-3d5f-4696-ae05-c910def2a3c1 with Priority: HIGHEST for action security_group_rules [ 595.864241] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c41f7cd-3d5f-4696-ae05-c910def2a3c1 with Priority: HIGHEST for action security_group_rules [ 595.864241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c41f7cd-3d5f-4696-ae05-c910def2a3c1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.864241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c41f7cd-3d5f-4696-ae05-c910def2a3c1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.864241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c41f7cd-3d5f-4696-ae05-c910def2a3c1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.864241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c41f7cd-3d5f-4696-ae05-c910def2a3c1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.864241] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c41f7cd-3d5f-4696-ae05-c910def2a3c1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.952140] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.140776] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: SUCCESS [ 596.141038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.141235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.141450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.141639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.141759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.141824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.141979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.142089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.142196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.142323] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.389885] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.390039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.390108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.391021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.391021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.391021] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c41f7cd-3d5f-4696-ae05-c910def2a3c1 already deleted. [ 596.391021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c41f7cd-3d5f-4696-ae05-c910def2a3c1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.456712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.456849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.456916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.457219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.457309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.457432] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe is going to be created. [ 596.486064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.486233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.486277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.486472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.486628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.500039] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: UNINITIALIZED for 2s [ 596.646529] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.647319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.647495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.647787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.648031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.648340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.648459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.648710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.648844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.648982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.649218] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.649366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.649458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.649661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.649858] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.649987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.650108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.650290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.650412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.650540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.650689] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.727924] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: SUCCESS [ 596.728157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.153518] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42226ea0-f68b-4929-8753-fb837ff84263: rpc.has_security_group_logging(os_id): False [ 597.173490] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.173646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.173718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.174102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.174204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.174409] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.174506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.174607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.174710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.174771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.174967] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.175078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.175158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.175279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.175321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.175499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.175594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.175687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.175810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.175886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.175965] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 is going to be created. [ 597.242312] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.242652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.242779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.243100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.243367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.259845] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: IN_PROGRESS for 2s [ 597.770329] env[65973]: INFO networking_nsxv3.common.synchronization [req-9fa7c3be-7b48-4934-af7a-04da5c82c19b req-28617e78-a65e-4cef-a88b-635277051ae1 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 597.771846] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 597.771923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.772086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.772163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.772486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.772723] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.772798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.773056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.773112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.773224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.773344] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.213792] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.214111] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.214111] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.214439] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.214935] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.214935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.215797] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.218228] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.218376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.218639] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.219744] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.219744] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.219744] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.219744] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.221502] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.224091] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.241965] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.242230] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.242415] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.242696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.243125] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-ffd6844f-03b3-4962-92f3-9950b049f47b taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.243413] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.243488] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.243813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.243966] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd6844f-03b3-4962-92f3-9950b049f47b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.276101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.276268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.276341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.276670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.276794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.277053] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.277153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.277234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.277403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.277535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.277620] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 already deleted. [ 598.277699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.513748] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: SUCCESS [ 598.513748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.513984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.514164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.514365] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.514472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.514709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.514709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.514816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.514816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.514901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.746471] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.746471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.746650] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.747454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.747454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.747454] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port ffd6844f-03b3-4962-92f3-9950b049f47b not found, creating... [ 598.747622] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.747786] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.747970] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.748234] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.748394] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.748698] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.748899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.749043] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.749281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.749437] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.749596] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: ffd6844f-03b3-4962-92f3-9950b049f47b is going to be created. [ 598.770040] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.770211] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.770431] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.770775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.770964] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.771193] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.019857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.019857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.019857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.019857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.020729] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.020729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.020729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.020729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.020729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.020729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.020914] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.274159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: SUCCESS [ 599.274538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.523895] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b3347a-b9e0-4205-b1b0-cc8c55878cbe: rpc.has_security_group_logging(os_id): False [ 599.544739] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.544938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.544938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.545275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.545480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.545792] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.545992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.546146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.546428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.546590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.546903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.547170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.547288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.547535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.547630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.547826] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.547930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.548035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.548209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.548290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.548380] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe is going to be created. [ 599.616221] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.616418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.616418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.616644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.616881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.630794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: IN_PROGRESS for 2s [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [req-9fa7c3be-7b48-4934-af7a-04da5c82c19b req-375f160e-95a3-49b9-9cb2-ab224244fe5b service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [req-9fa7c3be-7b48-4934-af7a-04da5c82c19b req-375f160e-95a3-49b9-9cb2-ab224244fe5b service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [req-9fa7c3be-7b48-4934-af7a-04da5c82c19b req-375f160e-95a3-49b9-9cb2-ab224244fe5b service nova] Enqueued Resource ID: ffd6844f-03b3-4962-92f3-9950b049f47b with Priority: HIGHEST for action port [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 599.835553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd6844f-03b3-4962-92f3-9950b049f47b with Priority: HIGHEST for action port [ 599.835820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.835820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.835820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.836189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.836265] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.838272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.838272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.838272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.838272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.838272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.838272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.838272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.838971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.838971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.838971] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.843317] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffd6844f-03b3-4962-92f3-9950b049f47b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.843317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.843317] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd6844f-03b3-4962-92f3-9950b049f47b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.345917] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.349284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349284] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffd6844f-03b3-4962-92f3-9950b049f47b with status ACTIVE [ 600.349284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.349284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.349284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.349893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.350126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.350278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.350496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.350706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.350950] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffd6844f-03b3-4962-92f3-9950b049f47b is going to be updated. [ 600.380022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.380239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.380239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.380453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.380583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.383520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffd6844f-03b3-4962-92f3-9950b049f47b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.557316] env[65973]: INFO networking_nsxv3.common.synchronization [None req-2fb2a6e1-31f6-4976-81a4-c884b966b594 None None] Enqueued Resource ID: c69376bb-2400-4930-a2d6-5173634a9e44 with Priority: HIGHEST for action port [ 600.557316] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69376bb-2400-4930-a2d6-5173634a9e44 with Priority: HIGHEST for action port [ 600.557544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69376bb-2400-4930-a2d6-5173634a9e44 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.557641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69376bb-2400-4930-a2d6-5173634a9e44" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.557704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69376bb-2400-4930-a2d6-5173634a9e44" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.557969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69376bb-2400-4930-a2d6-5173634a9e44" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.558570] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69376bb-2400-4930-a2d6-5173634a9e44',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.853825] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.063660] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c69376bb-2400-4930-a2d6-5173634a9e44 [ 601.063915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.064077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.064135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.064501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.064501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.064631] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c69376bb-2400-4930-a2d6-5173634a9e44 already deleted. [ 601.064631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69376bb-2400-4930-a2d6-5173634a9e44" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.357038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.357302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.358120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.358332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.358435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.358546] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be created. [ 601.388546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.388739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.388825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.389091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.389259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.400281] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: UNINITIALIZED for 2s [ 601.526688] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e0ec2cf9-b67e-4cdb-8c70-7c6055423629 None None] Enqueued Resource ID: d092f868-8f0e-470c-80ef-ca945a7d3de2 with Priority: HIGHEST for action port [ 601.527590] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d092f868-8f0e-470c-80ef-ca945a7d3de2 with Priority: HIGHEST for action port [ 601.528249] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d092f868-8f0e-470c-80ef-ca945a7d3de2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.528557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d092f868-8f0e-470c-80ef-ca945a7d3de2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.528673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d092f868-8f0e-470c-80ef-ca945a7d3de2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.529707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d092f868-8f0e-470c-80ef-ca945a7d3de2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.530759] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d092f868-8f0e-470c-80ef-ca945a7d3de2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.534252] env[65973]: INFO networking_nsxv3.common.synchronization [req-93650471-26cd-4e3f-81b0-d681e648aa07 req-f7b9648c-3c38-423e-94fb-a207505f1e84 tempest-DeleteServersAdminTestJSON-1531171471 tempest-DeleteServersAdminTestJSON-1531171471-project-member] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 601.534889] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 601.535257] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.535402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.535483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.535785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.537193] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.537600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.537600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.537600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.537768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.537805] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.645339] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: SUCCESS [ 601.645799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.960900] env[65973]: INFO networking_nsxv3.common.synchronization [req-5fa23904-1caa-483f-a926-34d985cc7ad9 req-fdfb544c-81f0-4602-8e25-cb3350fd719a tempest-ServerDiagnosticsNegativeTest-71583505 tempest-ServerDiagnosticsNegativeTest-71583505-project-member] Enqueued Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 601.960900] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGHEST for action security_group_members [ 601.961755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.962143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.964676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.964676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.964676] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.036243] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d092f868-8f0e-470c-80ef-ca945a7d3de2 [ 602.036499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.036635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.036703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.036919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.037017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.037113] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d092f868-8f0e-470c-80ef-ca945a7d3de2 already deleted. [ 602.037191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d092f868-8f0e-470c-80ef-ca945a7d3de2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.040373] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.040482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.040482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.042349] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.042349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 already deleted. [ 602.042349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.322964] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.323916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.323916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.323916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.325626] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.325626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.325626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.325626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.325784] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.326379] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.326379] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.326379] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.326379] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.326379] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.326592] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.326592] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.348822] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.348822] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.349586] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.349586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.349956] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.350204] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.350367] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.351065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.351065] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.469375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.469658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.469658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.469920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.470062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.470293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.470429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.470499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.470668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.470750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.470836] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c is going to be updated. [ 602.507719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.507864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.507940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.508596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.508738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.520977] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: IN_PROGRESS for 2s [ 602.586277] env[65973]: INFO networking_nsxv3.common.synchronization [None req-81b30358-93a4-49ca-8711-894571e64f61 None None] Enqueued Resource ID: d54fd8f7-859d-47db-8fa2-f47df5ab96d3 with Priority: HIGHEST for action port [ 602.586277] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54fd8f7-859d-47db-8fa2-f47df5ab96d3 with Priority: HIGHEST for action port [ 602.586277] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d54fd8f7-859d-47db-8fa2-f47df5ab96d3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.586277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d54fd8f7-859d-47db-8fa2-f47df5ab96d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.586277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d54fd8f7-859d-47db-8fa2-f47df5ab96d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.586277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d54fd8f7-859d-47db-8fa2-f47df5ab96d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.586277] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d54fd8f7-859d-47db-8fa2-f47df5ab96d3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.857022] env[65973]: INFO networking_nsxv3.common.synchronization [req-1f3fc861-05fa-41ec-b4e8-15e4ce073510 req-4a17b466-9f29-412d-a62e-894060c4b40a tempest-VolumesAssistedSnapshotsTest-1512252783 tempest-VolumesAssistedSnapshotsTest-1512252783-project-member] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 602.857022] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.857022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 not found, creating... [ 602.857022] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.857022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.857610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.857610] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.857610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.857610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.857762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.857870] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.858010] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 is going to be created. [ 602.859610] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 602.859728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.859910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.859983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.860184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.860327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.860430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.860473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.860611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.860687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.860776] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.889533] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.889533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.889533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.889533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.889533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.889533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.090023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d54fd8f7-859d-47db-8fa2-f47df5ab96d3 [ 603.090023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.090023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.090023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.090023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.090023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.090023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d54fd8f7-859d-47db-8fa2-f47df5ab96d3 already deleted. [ 603.090023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d54fd8f7-859d-47db-8fa2-f47df5ab96d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.342344] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.342574] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-669" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.342574] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-669" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.342847] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-669" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.343214] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.343416] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.343497] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.344127] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.344462] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.344834] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.345112] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.345202] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.345290] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.345410] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.345568] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.345712] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.363813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.363979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.364061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.364364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.364797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.364797] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.364967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.364967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.365321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.365321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.365442] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa already deleted. [ 603.365551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.370387] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.370639] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.370765] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.371075] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-669" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.371515] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.372054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.372262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.372707] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.372918] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97f5bd9f-1441-4ea9-a91c-11e6434bee7b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.413659] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 603.414015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.414543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.414543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.414649] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.414731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.414769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.415351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.415351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.415351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.415351] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.595635] env[65973]: INFO networking_nsxv3.common.synchronization [req-93650471-26cd-4e3f-81b0-d681e648aa07 req-e3885f83-33a4-486e-9648-5bbff44d2dbe service nova] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_rules [ 603.595916] env[65973]: INFO networking_nsxv3.common.synchronization [req-93650471-26cd-4e3f-81b0-d681e648aa07 req-e3885f83-33a4-486e-9648-5bbff44d2dbe service nova] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 603.595916] env[65973]: INFO networking_nsxv3.common.synchronization [req-93650471-26cd-4e3f-81b0-d681e648aa07 req-e3885f83-33a4-486e-9648-5bbff44d2dbe service nova] Enqueued Resource ID: 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 with Priority: HIGHEST for action port [ 603.596554] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_rules [ 603.596743] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 603.596876] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 with Priority: HIGHEST for action port [ 603.598102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.598102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.598102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.598509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.598509] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.599757] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.599757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.599757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.599936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.600045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.600204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.600528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.600528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.600627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.600725] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.601624] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.601729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.601795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.601940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.602016] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.876143] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.876316] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.876412] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.877093] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.877264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.877415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 97f5bd9f-1441-4ea9-a91c-11e6434bee7b not found, creating... [ 603.877752] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.877915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.878035] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.878268] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.878436] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.878720] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.878855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.878964] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.879510] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.879778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.879843] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 97f5bd9f-1441-4ea9-a91c-11e6434bee7b is going to be created. [ 603.900547] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.900768] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.900976] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.901375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.901490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.901706] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.917815] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.917991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.918071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.918287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.918461] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.918621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.918670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.918836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.919027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.919027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.919187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.919280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.919342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.919499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.919639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.919727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.919829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.919935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.920032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.920123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.920207] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.104520] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.104520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.104732] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.106704] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 with status ACTIVE [ 604.106704] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.106704] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.106704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.107097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.107097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.107434] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.107598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.107654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.108174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.108174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.108174] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1 is going to be updated. [ 604.148165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.148165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.148165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.148165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.148165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.148165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf85cb7-d30e-4fff-aac7-2f23bee2f3e1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.173800] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ee28bc64-747e-4ac7-8260-a59effd9c660 tempest-ServersTestJSON-1831836165 tempest-ServersTestJSON-1831836165-project-member] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 604.174530] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 604.175596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.176108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.176239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.176610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.176610] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.183983] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5ef016bc-73ef-4945-8574-3c8a88f03efa None None] Enqueued Resource ID: db6c2641-81e1-46a5-bf9f-1fea889bbf0e with Priority: HIGHEST for action port [ 604.188021] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db6c2641-81e1-46a5-bf9f-1fea889bbf0e with Priority: HIGHEST for action port [ 604.188253] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-db6c2641-81e1-46a5-bf9f-1fea889bbf0e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.188385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db6c2641-81e1-46a5-bf9f-1fea889bbf0e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.188453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db6c2641-81e1-46a5-bf9f-1fea889bbf0e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.188926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db6c2641-81e1-46a5-bf9f-1fea889bbf0e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.189335] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db6c2641-81e1-46a5-bf9f-1fea889bbf0e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.320029] env[65973]: INFO networking_nsxv3.common.synchronization [None req-7822db64-f599-489a-9b02-63a4219b60c2 tempest-ServersTestJSON-1831836165 tempest-ServersTestJSON-1831836165-project-member] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 604.320029] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 604.320402] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.320949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.426721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f329967-b7d9-481b-b6ad-3fa408a45e60: rpc.has_security_group_logging(os_id): False [ 604.445800] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.445971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.446030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.446260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.446351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.446541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.446636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.446694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.446917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.446992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.447202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.447294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.447352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.447555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.447615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.449022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.449022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.449022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.449022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.449022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.449257] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be created. [ 604.516563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.517625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.517886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.518227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.519026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.532591] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 604.539208] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23be5268-bae9-4d02-addf-8da8a520e87c in Status: SUCCESS [ 604.539352] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c deletion is rescheduled due to dependency. [ 604.539946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.611538] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.691217] env[65973]: INFO networking_nsxv3.common.synchronization [req-1f3fc861-05fa-41ec-b4e8-15e4ce073510 req-3928282c-5723-4852-9406-eeac12c3cb73 service nova] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 604.691217] env[65973]: INFO networking_nsxv3.common.synchronization [req-1f3fc861-05fa-41ec-b4e8-15e4ce073510 req-3928282c-5723-4852-9406-eeac12c3cb73 service nova] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 604.693198] env[65973]: INFO networking_nsxv3.common.synchronization [req-1f3fc861-05fa-41ec-b4e8-15e4ce073510 req-3928282c-5723-4852-9406-eeac12c3cb73 service nova] Enqueued Resource ID: 97f5bd9f-1441-4ea9-a91c-11e6434bee7b with Priority: HIGHEST for action port [ 604.697259] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db6c2641-81e1-46a5-bf9f-1fea889bbf0e [ 604.697259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.697259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.697259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.697259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.699499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.700096] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db6c2641-81e1-46a5-bf9f-1fea889bbf0e already deleted. [ 604.700096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db6c2641-81e1-46a5-bf9f-1fea889bbf0e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.700096] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_rules [ 604.701404] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 604.701404] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97f5bd9f-1441-4ea9-a91c-11e6434bee7b with Priority: HIGHEST for action port [ 604.702096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.702202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.702202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.702790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.702790] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.703977] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.704213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.704268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.704578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.704642] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.704737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.706061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.706061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.706061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.706061] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.706381] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.706381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.706543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.706675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.706724] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97f5bd9f-1441-4ea9-a91c-11e6434bee7b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.733583] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.734044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.734044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.734161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.734198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.734301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 already deleted. [ 604.734409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.735596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.735596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.735596] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.114812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.115016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.115075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.115291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.115433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.115555] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be created. [ 605.147784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.147784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.147784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.147784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.147784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.160035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: UNINITIALIZED for 2s [ 605.212517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.212784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.212906] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.213947] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97f5bd9f-1441-4ea9-a91c-11e6434bee7b with status ACTIVE [ 605.214158] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.214298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.214372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.214552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.214638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.214813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.214912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.214986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.216943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.216943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.216943] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.216943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.217170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.217919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.217919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.217919] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97f5bd9f-1441-4ea9-a91c-11e6434bee7b is going to be updated. [ 605.243668] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.243861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.244759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.244759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.244759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.244759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97f5bd9f-1441-4ea9-a91c-11e6434bee7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.262812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.262812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.262812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.262812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.262812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.262812] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 already deleted. [ 605.262812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.268216] env[65973]: INFO networking_nsxv3.common.synchronization [req-e0012cdf-c117-4a59-bab6-76ef2e570147 req-842a7865-ab84-4309-b9cb-1eaf6db18400 tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: 1ab49a3e-d652-4770-8c56-28af1d341e7b with Priority: HIGHEST for action security_group_rules [ 605.268735] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab49a3e-d652-4770-8c56-28af1d341e7b with Priority: HIGHEST for action security_group_rules [ 605.269046] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab49a3e-d652-4770-8c56-28af1d341e7b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.269176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab49a3e-d652-4770-8c56-28af1d341e7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.269244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab49a3e-d652-4770-8c56-28af1d341e7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.269490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab49a3e-d652-4770-8c56-28af1d341e7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.269571] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab49a3e-d652-4770-8c56-28af1d341e7b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.330560] env[65973]: INFO networking_nsxv3.common.synchronization [req-174dbee4-7584-4d5f-87b2-566036959ccd req-5f136d2a-43f3-41fe-ad7f-5b041fa72471 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 605.331484] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 605.331894] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.332036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.332124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.332358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.334833] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.334833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.334833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.334833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.334833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.334833] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.710169] env[65973]: INFO networking_nsxv3.common.synchronization [None req-91217ed9-d54b-415d-ad53-a8739b39c9c8 tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 605.710788] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 605.711142] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.711314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.711372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.711621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.711712] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.720398] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.750036] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.750036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.750262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.751471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.751471] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.751471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.751471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.751471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.751471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.751777] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.751777] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.751777] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.751875] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.751994] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.752113] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.752239] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.780027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.780027] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.780027] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.780027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.780027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-2876a8f8-3914-41f6-b82f-2bd16c774421 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.780027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.780027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.780817] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.781187] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2876a8f8-3914-41f6-b82f-2bd16c774421',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.791992] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.792255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.792255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.792521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.792772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.792861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab49a3e-d652-4770-8c56-28af1d341e7b already deleted. [ 605.792964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab49a3e-d652-4770-8c56-28af1d341e7b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.840416] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.222617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.223041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.223222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.223553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.223750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.223946] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa is going to be created. [ 606.238697] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.241529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.241529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.241529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.241529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.241529] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c already deleted. [ 606.241529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.258783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.259311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.259472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.259762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.261926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.274368] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: UNINITIALIZED for 2s [ 606.285287] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.285287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.285287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.285287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.285287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.285570] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 2876a8f8-3914-41f6-b82f-2bd16c774421 not found, creating... [ 606.286110] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.286110] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.286110] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.286344] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.286422] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.286727] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.287239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.287239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.287239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.287370] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.287584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 2876a8f8-3914-41f6-b82f-2bd16c774421 is going to be created. [ 606.320931] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.321246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.321867] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.321867] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.321867] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.322018] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.341318] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.382037] env[65973]: INFO networking_nsxv3.common.synchronization [None req-226862e7-d91a-4ede-b811-b72a8bc295dd tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 606.382037] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 606.382037] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.382037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.382037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.382037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.382037] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.546234] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 606.546419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.845047] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.845047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.845047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.845047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.845047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.845047] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 606.877354] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.877610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.877610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.877828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.877981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.890564] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 606.910258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.910413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.910479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.910699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.910788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.910882] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c already deleted. [ 606.910960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.170138] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 607.170413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.170585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.170808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.171022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.171164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.171207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.171352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.171434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.171551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.171674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.420092] env[65973]: INFO networking_nsxv3.common.synchronization [req-174dbee4-7584-4d5f-87b2-566036959ccd req-6e5f6a4c-1fbd-4206-8693-2938ccd9617d service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 607.420300] env[65973]: INFO networking_nsxv3.common.synchronization [req-174dbee4-7584-4d5f-87b2-566036959ccd req-6e5f6a4c-1fbd-4206-8693-2938ccd9617d service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 607.420430] env[65973]: INFO networking_nsxv3.common.synchronization [req-174dbee4-7584-4d5f-87b2-566036959ccd req-6e5f6a4c-1fbd-4206-8693-2938ccd9617d service nova] Enqueued Resource ID: 2876a8f8-3914-41f6-b82f-2bd16c774421 with Priority: HIGHEST for action port [ 607.421119] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 607.421330] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 607.421487] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2876a8f8-3914-41f6-b82f-2bd16c774421 with Priority: HIGHEST for action port [ 607.421749] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.421885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.421988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.422266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.422343] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.423374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.423374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.423633] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2876a8f8-3914-41f6-b82f-2bd16c774421 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.423725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.423763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.423968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.424073] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2876a8f8-3914-41f6-b82f-2bd16c774421',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.674596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.674988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.675135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.675412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.675662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.676164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.676289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.676540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.676642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.676971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.677239] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.677503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.677693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.677907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.678127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.678278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.678376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.678596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.678752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.678887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.679040] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.928884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.928884] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2876a8f8-3914-41f6-b82f-2bd16c774421 with status ACTIVE [ 607.928884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.928884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.928884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.928884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.929720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.929720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.929720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.929720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.929720] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2876a8f8-3914-41f6-b82f-2bd16c774421 is going to be updated. [ 607.957859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.957859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.957985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.958556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.958556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.958556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2876a8f8-3914-41f6-b82f-2bd16c774421" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.181907] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25ed87c4-ad1f-48f1-99b0-f293d53e44d4: rpc.has_security_group_logging(os_id): False [ 608.200643] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.200643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.200643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.200869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.200869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.201513] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.201513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.201513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.201513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.201513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.201513] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.201756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.201756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.201824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.201920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.202119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.202643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.202643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.202643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.202643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.202643] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be created. [ 608.258837] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.258967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.259048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.259254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.259543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.272303] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 608.283689] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: SUCCESS [ 608.283998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.284310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.284547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.284972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.285256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.285295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.285949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.285949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.285949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.286082] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.789768] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.903220] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 608.904116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.904116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.904116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.904353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.904521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.904626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.904879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.905009] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.906111] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.293866] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b43cc61c-6eaf-4868-a452-7def78ad6faa: rpc.has_security_group_logging(os_id): False [ 609.315327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.315598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.315681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.315927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.315997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.316260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.316432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.316432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.316604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.316678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.316753] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa is going to be created. [ 609.402143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.403199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.403844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.404135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.404430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.408844] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.417595] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: IN_PROGRESS for 2s [ 609.580248] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8bfa72cc-f720-43aa-a156-ce38b22bc947 None None] Enqueued Resource ID: 9e883708-77a9-4540-a856-b3697247b688 with Priority: HIGHEST for action port [ 609.580248] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e883708-77a9-4540-a856-b3697247b688 with Priority: HIGHEST for action port [ 609.580248] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e883708-77a9-4540-a856-b3697247b688 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.580248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e883708-77a9-4540-a856-b3697247b688" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.580248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e883708-77a9-4540-a856-b3697247b688" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.580248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e883708-77a9-4540-a856-b3697247b688" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.580248] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e883708-77a9-4540-a856-b3697247b688',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.914030] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.082213] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e883708-77a9-4540-a856-b3697247b688 [ 610.082213] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.082213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.082213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.082213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.082213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.082213] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e883708-77a9-4540-a856-b3697247b688 already deleted. [ 610.082213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e883708-77a9-4540-a856-b3697247b688" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.288223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 610.288223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.414556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.414895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.414895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.415251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.415251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.415251] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 610.455178] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.455178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.455178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.455178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.455404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.468296] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 611.433967] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: SUCCESS [ 611.434302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.880134] env[65973]: INFO networking_nsxv3.common.synchronization [None req-044640b3-f18d-4b6a-8324-850c75fa45a5 None None] Enqueued Resource ID: 1f7d18a5-2835-4627-b98a-98db985151b0 with Priority: HIGHEST for action port [ 611.881643] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7d18a5-2835-4627-b98a-98db985151b0 with Priority: HIGHEST for action port [ 611.881643] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f7d18a5-2835-4627-b98a-98db985151b0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.881822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f7d18a5-2835-4627-b98a-98db985151b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.881822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f7d18a5-2835-4627-b98a-98db985151b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.882416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f7d18a5-2835-4627-b98a-98db985151b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.882607] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7d18a5-2835-4627-b98a-98db985151b0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.385278] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f7d18a5-2835-4627-b98a-98db985151b0 [ 612.385546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.385714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.385832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.386036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.386162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.386259] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f7d18a5-2835-4627-b98a-98db985151b0 already deleted. [ 612.386331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f7d18a5-2835-4627-b98a-98db985151b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.483042] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 612.483042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.485349] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.485349] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.535321] env[65973]: INFO networking_nsxv3.common.synchronization [req-68a628fe-2475-44a2-b55f-cad860addfc5 req-0175a70d-2fda-48d0-af61-7dcb463b600f tempest-InstanceActionsTestJSON-279928980 tempest-InstanceActionsTestJSON-279928980-project-member] Enqueued Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 612.536305] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 612.536736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.536896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.536995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.537440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.537645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.537787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.537866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.538056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.538261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.538261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.898295] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.898295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-467" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.898295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-467" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.898295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-467" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.898601] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.898601] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.898723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.898897] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.899078] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.899266] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.899373] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.899479] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.899571] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.899673] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.899822] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.899979] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.920970] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.921285] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.921422] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.921644] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-467" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.922085] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-0b69dad2-293c-4406-aa21-564c9201fd9c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.922302] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.922463] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.924321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.925027] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b69dad2-293c-4406-aa21-564c9201fd9c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.988430] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.988430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.988430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.988430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.988707] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.988783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.988817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.989014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.989124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.989241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.989479] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.989551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.989667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.989790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.989946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.990053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.990130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.990345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.990403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.990457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.990558] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.041305] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.041736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.041736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.041736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.041960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.042470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.042470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.042470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.042470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.042470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.042717] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 already deleted. [ 613.042717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.427241] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.427512] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.427684] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.428500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.428779] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.429052] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 0b69dad2-293c-4406-aa21-564c9201fd9c not found, creating... [ 613.429624] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.429827] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.430654] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.431160] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.431940] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.432086] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.432362] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.432563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.432916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.433479] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.434249] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 0b69dad2-293c-4406-aa21-564c9201fd9c is going to be created. [ 613.459848] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.460119] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.460176] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.460483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.461047] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.461367] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.494411] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f329967-b7d9-481b-b6ad-3fa408a45e60: rpc.has_security_group_logging(os_id): False [ 613.521547] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.521859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.521859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.521975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.522093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.522400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.522546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.522657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.522935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.523058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.523615] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.523755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.523843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.524030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.524117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.524325] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.524422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.524485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.524643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.524737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.524825] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 613.634534] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.634762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.634762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.634958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.635382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.651682] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 613.746587] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b2236c61-a9a1-4f58-b104-1fd8ac92db0e None None] Enqueued Resource ID: 91cd0d42-40d7-4c97-9819-940d11bb5ff6 with Priority: HIGHEST for action port [ 613.747731] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91cd0d42-40d7-4c97-9819-940d11bb5ff6 with Priority: HIGHEST for action port [ 613.747883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-91cd0d42-40d7-4c97-9819-940d11bb5ff6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.747987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91cd0d42-40d7-4c97-9819-940d11bb5ff6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.747987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91cd0d42-40d7-4c97-9819-940d11bb5ff6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.748364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91cd0d42-40d7-4c97-9819-940d11bb5ff6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.748503] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cd0d42-40d7-4c97-9819-940d11bb5ff6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.846790] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e1799675-53f1-44f6-bb5c-27dfc4717538 None None] Enqueued Resource ID: 66e9cc68-1317-489e-8e45-c48475c8962f with Priority: HIGHEST for action port [ 613.847421] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66e9cc68-1317-489e-8e45-c48475c8962f with Priority: HIGHEST for action port [ 613.847835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-66e9cc68-1317-489e-8e45-c48475c8962f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.847953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66e9cc68-1317-489e-8e45-c48475c8962f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.848063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66e9cc68-1317-489e-8e45-c48475c8962f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.848354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66e9cc68-1317-489e-8e45-c48475c8962f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.848876] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e9cc68-1317-489e-8e45-c48475c8962f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.179652] env[65973]: INFO networking_nsxv3.common.synchronization [req-19818a42-95c5-44a2-971d-c0e3684c24b3 req-05685a2e-53a4-4f61-8ab8-47e30cfd84c2 tempest-ServerDiagnosticsTest-486114040 tempest-ServerDiagnosticsTest-486114040-project-member] Enqueued Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 614.180305] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGHEST for action security_group_members [ 614.181874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.182315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.182424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.183148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.183380] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.183485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.187088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.187088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.187088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.187088] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.202174] env[65973]: INFO networking_nsxv3.common.synchronization [req-68a628fe-2475-44a2-b55f-cad860addfc5 req-4cfc6623-180d-49e3-afd0-6c9e6b57a48f service nova] Enqueued Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_rules [ 614.202322] env[65973]: INFO networking_nsxv3.common.synchronization [req-68a628fe-2475-44a2-b55f-cad860addfc5 req-4cfc6623-180d-49e3-afd0-6c9e6b57a48f service nova] Enqueued Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 614.203103] env[65973]: INFO networking_nsxv3.common.synchronization [req-68a628fe-2475-44a2-b55f-cad860addfc5 req-4cfc6623-180d-49e3-afd0-6c9e6b57a48f service nova] Enqueued Resource ID: 0b69dad2-293c-4406-aa21-564c9201fd9c with Priority: HIGHEST for action port [ 614.204135] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_rules [ 614.204319] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 614.204421] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b69dad2-293c-4406-aa21-564c9201fd9c with Priority: HIGHEST for action port [ 614.204704] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.204836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.204894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.205172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.205251] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.206192] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.206333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.206393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.206560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.206651] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.207903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.207903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.207903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.207903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.207903] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.209854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b69dad2-293c-4406-aa21-564c9201fd9c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.209854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.209854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.211402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.211559] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b69dad2-293c-4406-aa21-564c9201fd9c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.251408] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91cd0d42-40d7-4c97-9819-940d11bb5ff6 [ 614.251408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.251408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.251408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.251770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.251770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.251770] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91cd0d42-40d7-4c97-9819-940d11bb5ff6 already deleted. [ 614.251909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91cd0d42-40d7-4c97-9819-940d11bb5ff6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.353261] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66e9cc68-1317-489e-8e45-c48475c8962f [ 614.353261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.353261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.353261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.353261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.353261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.353261] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66e9cc68-1317-489e-8e45-c48475c8962f already deleted. [ 614.353261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66e9cc68-1317-489e-8e45-c48475c8962f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.508943] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a3c05246-737e-476f-b722-8287d252a9c0 None None] Enqueued Resource ID: d65606dd-7aea-4dbb-8685-24cf8a1132c6 with Priority: HIGHEST for action port [ 614.509519] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65606dd-7aea-4dbb-8685-24cf8a1132c6 with Priority: HIGHEST for action port [ 614.512063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d65606dd-7aea-4dbb-8685-24cf8a1132c6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.512207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d65606dd-7aea-4dbb-8685-24cf8a1132c6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.512442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d65606dd-7aea-4dbb-8685-24cf8a1132c6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.512783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d65606dd-7aea-4dbb-8685-24cf8a1132c6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.512893] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65606dd-7aea-4dbb-8685-24cf8a1132c6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.688823] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.689345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.689345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.689345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.689519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.689693] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.689997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.689997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.690152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.693681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.694426] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 is going to be updated. [ 614.715031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.715031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.715031] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.715779] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b69dad2-293c-4406-aa21-564c9201fd9c with status ACTIVE [ 614.716556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.716556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.716556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.716556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.716556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.716789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.716789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.716789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.717346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.717346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.717346] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.717346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.717346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.717595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.717595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.717732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b69dad2-293c-4406-aa21-564c9201fd9c is going to be updated. [ 614.731636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.731914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.732115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.734304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.734475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.747035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: IN_PROGRESS for 2s [ 614.747857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.747999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.748067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.748286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.748431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.748599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b69dad2-293c-4406-aa21-564c9201fd9c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.017408] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d65606dd-7aea-4dbb-8685-24cf8a1132c6 [ 615.017557] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.018132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.018867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.018867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.018867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.018867] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d65606dd-7aea-4dbb-8685-24cf8a1132c6 already deleted. [ 615.019323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d65606dd-7aea-4dbb-8685-24cf8a1132c6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.150776] env[65973]: INFO networking_nsxv3.common.synchronization [req-f8888f54-a747-4286-9726-549f57304a67 req-fd74ab8b-fa0d-457f-a76a-6d76cf8eba2d tempest-ServersAdminNegativeTestJSON-821105226 tempest-ServersAdminNegativeTestJSON-821105226-project-member] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 615.150776] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 615.150776] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.150776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.150776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.151175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.151175] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.151347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.151413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.151600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.151685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.151784] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.221458] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.621097] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.621601] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.621601] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.621717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.621930] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.622150] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.622246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.622399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.622538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.622745] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.622848] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.622955] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.623063] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.623172] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.623271] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.623398] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.643934] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.643934] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.643934] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.643934] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.643934] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b541aca5-577b-4647-b39c-2e9193a96e26 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.644321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.644321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.644757] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.644915] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b541aca5-577b-4647-b39c-2e9193a96e26',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.657931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.657931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.657931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.658348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.658348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.658348] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 already deleted. [ 615.658348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.666483] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 615.666708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.723676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.723964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.724080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.724259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.724350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.724462] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 is going to be created. [ 615.768927] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.769267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.769414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.769719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.769884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.782995] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: UNINITIALIZED for 2s [ 616.147331] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.147591] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.147822] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.148144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.148309] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.148478] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b541aca5-577b-4647-b39c-2e9193a96e26 not found, creating... [ 616.148835] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.149031] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.149144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.149407] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.149606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.149880] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.150053] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.150187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.150417] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.150591] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.150721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b541aca5-577b-4647-b39c-2e9193a96e26 is going to be created. [ 616.174086] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.174727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.174727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.174865] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.175154] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.175409] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.765195] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42226ea0-f68b-4929-8753-fb837ff84263 in Status: SUCCESS [ 616.765601] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 deletion is rescheduled due to dependency. [ 616.765681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.969378] env[65973]: INFO networking_nsxv3.common.synchronization [req-f8888f54-a747-4286-9726-549f57304a67 req-dd9b7cb1-f979-4dd5-bace-26a5e2cf216f service nova] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_rules [ 616.969378] env[65973]: INFO networking_nsxv3.common.synchronization [req-f8888f54-a747-4286-9726-549f57304a67 req-dd9b7cb1-f979-4dd5-bace-26a5e2cf216f service nova] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 616.969560] env[65973]: INFO networking_nsxv3.common.synchronization [req-f8888f54-a747-4286-9726-549f57304a67 req-dd9b7cb1-f979-4dd5-bace-26a5e2cf216f service nova] Enqueued Resource ID: b541aca5-577b-4647-b39c-2e9193a96e26 with Priority: HIGHEST for action port [ 616.970464] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_rules [ 616.970784] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 616.970784] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b541aca5-577b-4647-b39c-2e9193a96e26 with Priority: HIGHEST for action port [ 616.972500] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.972672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.972989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.973052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.973143] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.976018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.976116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.976116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.976488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.976676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.977017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.977017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.977017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.977287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.977287] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.978358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b541aca5-577b-4647-b39c-2e9193a96e26 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.978546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.978546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.979035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.979035] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b541aca5-577b-4647-b39c-2e9193a96e26',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.048434] env[65973]: INFO networking_nsxv3.common.synchronization [None req-0e7c1b39-961f-4cf7-9def-7a1605861b65 None None] Enqueued Resource ID: d331261b-a71e-4226-97df-5ff1a18af4e3 with Priority: HIGHEST for action port [ 617.049366] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d331261b-a71e-4226-97df-5ff1a18af4e3 with Priority: HIGHEST for action port [ 617.049706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d331261b-a71e-4226-97df-5ff1a18af4e3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.049838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d331261b-a71e-4226-97df-5ff1a18af4e3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.049908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d331261b-a71e-4226-97df-5ff1a18af4e3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.050213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d331261b-a71e-4226-97df-5ff1a18af4e3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.050636] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d331261b-a71e-4226-97df-5ff1a18af4e3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.481643] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.485022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.485022] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.485022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b541aca5-577b-4647-b39c-2e9193a96e26 with status ACTIVE [ 617.485022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.485022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.485022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.485022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.485022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.486931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.486931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.486931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.488143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.488143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.488143] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b541aca5-577b-4647-b39c-2e9193a96e26 is going to be updated. [ 617.528470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.528713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.528713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.528900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.529484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.529484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b541aca5-577b-4647-b39c-2e9193a96e26" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.556413] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d331261b-a71e-4226-97df-5ff1a18af4e3 [ 617.556899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.556899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.556899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.557106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.557164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.557300] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d331261b-a71e-4226-97df-5ff1a18af4e3 already deleted. [ 617.557394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d331261b-a71e-4226-97df-5ff1a18af4e3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.584552] env[65973]: INFO networking_nsxv3.common.synchronization [req-c0e56e6d-050c-4097-8ab8-55eb8e42e05e req-77cadb48-8cc1-4e32-91dc-9b89f0b01f0b tempest-ServersTestJSON-1831836165 tempest-ServersTestJSON-1831836165-project-member] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 617.584808] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 617.585274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.585344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.585381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.585625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.585869] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.585952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.585952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.586121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.586213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.586308] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.794233] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: SUCCESS [ 617.794530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.795030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.796789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.797008] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.797199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.797268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.797435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.799510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.799510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.799510] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.991187] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.074556] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.074660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-362" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.074857] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-362" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.075486] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-362" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.075692] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.075880] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.076015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.076270] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.076424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.076708] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.076886] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.077077] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.077242] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.077409] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.077575] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.077796] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.088986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.089173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.089224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.089436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.089527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.089718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.089817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.089877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.090042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.090121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.090263] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 already deleted. [ 618.090327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.098193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.098403] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.098520] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.098732] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-362" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.099091] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-1eb46345-87ec-42be-9d00-d695c1ee05a2 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.099350] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.099560] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.099766] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.099861] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb46345-87ec-42be-9d00-d695c1ee05a2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.179025] env[65973]: INFO networking_nsxv3.common.synchronization [None req-df3f1242-01b9-4502-952b-e8d434bec5fa None None] Enqueued Resource ID: 638b7ad6-6727-40ff-b408-ade098e991aa with Priority: HIGHEST for action port [ 618.179257] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638b7ad6-6727-40ff-b408-ade098e991aa with Priority: HIGHEST for action port [ 618.179768] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-638b7ad6-6727-40ff-b408-ade098e991aa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.179899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-638b7ad6-6727-40ff-b408-ade098e991aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.179968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-638b7ad6-6727-40ff-b408-ade098e991aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.180259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-638b7ad6-6727-40ff-b408-ade098e991aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.180343] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('638b7ad6-6727-40ff-b408-ade098e991aa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.303228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.303475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.303475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.303790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.303889] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.303996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.304101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.304219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.304322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.304411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.304556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.304650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.304703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.304873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.305030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.305125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.305180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.305323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.305401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.305520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.305596] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.494064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.494223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.494289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.494533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.494619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.495625] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be created. [ 618.525361] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.525533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.525697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.526015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.526202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.538967] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: UNINITIALIZED for 2s [ 618.606025] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f0f231bb-d8c7-4f7f-b8ca-f4dc4001832d None None] Enqueued Resource ID: a4cb6284-8456-49cd-b112-b144e999cc7a with Priority: HIGHEST for action port [ 618.606025] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.606025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.606025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.606025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.606025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.607248] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 1eb46345-87ec-42be-9d00-d695c1ee05a2 not found, creating... [ 618.607586] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.607851] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.607998] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.608298] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.608454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.608783] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.608947] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.609183] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.609319] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.609463] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.609598] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 1eb46345-87ec-42be-9d00-d695c1ee05a2 is going to be created. [ 618.611634] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4cb6284-8456-49cd-b112-b144e999cc7a with Priority: HIGHEST for action port [ 618.612082] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4cb6284-8456-49cd-b112-b144e999cc7a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.612283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4cb6284-8456-49cd-b112-b144e999cc7a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.612283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4cb6284-8456-49cd-b112-b144e999cc7a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.612494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4cb6284-8456-49cd-b112-b144e999cc7a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.612572] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4cb6284-8456-49cd-b112-b144e999cc7a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.636956] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.637880] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.637880] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.637880] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.638079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.639606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.683178] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 638b7ad6-6727-40ff-b408-ade098e991aa [ 618.683411] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.683544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.683629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.683830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.683932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.684038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:638b7ad6-6727-40ff-b408-ade098e991aa already deleted. [ 618.684139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-638b7ad6-6727-40ff-b408-ade098e991aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.810492] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27: rpc.has_security_group_logging(os_id): False [ 618.835269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.835269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.835269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.835269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.835269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.835269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.835538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.835538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.835538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.835626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.836677] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.836677] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.836677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.837451] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 is going to be created. [ 618.923923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.923923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.923923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.923923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.923923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.946975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: IN_PROGRESS for 2s [ 619.116021] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4cb6284-8456-49cd-b112-b144e999cc7a [ 619.119084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.119084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.119084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.119084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.119084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.119084] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4cb6284-8456-49cd-b112-b144e999cc7a already deleted. [ 619.119084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4cb6284-8456-49cd-b112-b144e999cc7a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.374886] env[65973]: INFO networking_nsxv3.common.synchronization [req-c0e56e6d-050c-4097-8ab8-55eb8e42e05e req-05da468d-e59e-46f7-b9a4-3488dac5c51a service nova] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 619.375350] env[65973]: INFO networking_nsxv3.common.synchronization [req-c0e56e6d-050c-4097-8ab8-55eb8e42e05e req-05da468d-e59e-46f7-b9a4-3488dac5c51a service nova] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 619.375622] env[65973]: INFO networking_nsxv3.common.synchronization [req-c0e56e6d-050c-4097-8ab8-55eb8e42e05e req-05da468d-e59e-46f7-b9a4-3488dac5c51a service nova] Enqueued Resource ID: 1eb46345-87ec-42be-9d00-d695c1ee05a2 with Priority: HIGHEST for action port [ 619.376325] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_rules [ 619.376611] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 619.376844] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb46345-87ec-42be-9d00-d695c1ee05a2 with Priority: HIGHEST for action port [ 619.377302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.381181] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.381181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.381181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.381181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.384855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.384855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.384855] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.384855] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eb46345-87ec-42be-9d00-d695c1ee05a2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.384855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.384855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.384855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.384855] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb46345-87ec-42be-9d00-d695c1ee05a2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.885227] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.889939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.889939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.889939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1eb46345-87ec-42be-9d00-d695c1ee05a2 with status ACTIVE [ 619.889939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.890160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.890345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.890451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.890538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.890731] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.890840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.890895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.892740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.892881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.893496] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.893496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.893496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.893496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.893793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.893793] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1eb46345-87ec-42be-9d00-d695c1ee05a2 is going to be updated. [ 619.928220] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.928837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.928837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.928837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.929534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.929743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eb46345-87ec-42be-9d00-d695c1ee05a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.391401] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.401607] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ecd08d0f-965c-4de0-bbe2-d2ca62f8c085 None None] Enqueued Resource ID: 0360baf1-3bab-418d-9556-6e37cebe9ef1 with Priority: HIGHEST for action port [ 620.402412] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0360baf1-3bab-418d-9556-6e37cebe9ef1 with Priority: HIGHEST for action port [ 620.402862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0360baf1-3bab-418d-9556-6e37cebe9ef1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.402988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0360baf1-3bab-418d-9556-6e37cebe9ef1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.403235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0360baf1-3bab-418d-9556-6e37cebe9ef1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.404208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0360baf1-3bab-418d-9556-6e37cebe9ef1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.404343] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0360baf1-3bab-418d-9556-6e37cebe9ef1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.552217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 620.552217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.552217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.552901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.553145] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.553278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.553349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.553530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.553617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.553708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.553801] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.833865] env[65973]: INFO networking_nsxv3.common.synchronization [req-f59a3336-6e3e-4464-9771-d74c4b40f9fb req-f29f4f0d-0745-432a-a952-9aa4cb281bcc tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: 5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff with Priority: HIGHEST for action security_group_rules [ 620.835034] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff with Priority: HIGHEST for action security_group_rules [ 620.835366] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.835481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.835537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.836115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.836115] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.896451] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.896835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.896835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.896955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.896955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.897062] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 is going to be created. [ 620.906528] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0360baf1-3bab-418d-9556-6e37cebe9ef1 [ 620.906924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.907218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.908248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.908248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.908248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.908355] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0360baf1-3bab-418d-9556-6e37cebe9ef1 already deleted. [ 620.908468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0360baf1-3bab-418d-9556-6e37cebe9ef1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.927740] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.927740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.927740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.927740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.927740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.936840] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: UNINITIALIZED for 2s [ 620.961324] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: SUCCESS [ 620.961564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.060904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.060904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.060904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.060904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.061519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.061519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.065260] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.356461] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.356541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.356577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.357055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.357055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.357055] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff already deleted. [ 621.357055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d26609d-bfa9-4fd8-b410-6bf76f1fb4ff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.539997] env[65973]: INFO networking_nsxv3.common.synchronization [req-95e37dbc-6a74-41bb-812e-b5ae2e37714f req-b0f5fc9e-ae90-401a-927b-bddca136fa2a tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 621.540681] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 621.542375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.542824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.542824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.542824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.543296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.543296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.543296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.543296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.543793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.543793] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.571197] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3: rpc.has_security_group_logging(os_id): False [ 621.595062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.595938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.595938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.595938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.596095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.596298] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.596404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.596472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.596667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.596732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.596953] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.598512] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.598512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.600645] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be created. [ 621.673148] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.673318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.674547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.674547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.674547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.688595] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 622.045854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.046261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.046551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.047110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.047327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.047681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.047892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.048039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.048467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.048624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.048763] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c already deleted. [ 622.048893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.151069] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.151069] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.151069] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.151324] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.151527] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.151682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.151795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.152030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.152174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.152373] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.152479] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.152579] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.152680] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.152780] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.152888] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.153017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.178826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.179160] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.179343] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.179464] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.179887] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.180083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.180196] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.180567] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.180710] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ed9ffd-d548-4a58-98fe-5dd21880a0a3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.683996] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.684253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.684386] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.684694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.684861] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.685053] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 not found, creating... [ 622.685367] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.685555] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.685736] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.686033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.686209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687579] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.687579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.687579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.687579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.687579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.687579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 is going to be created. [ 622.711918] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.712119] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.712332] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.712488] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.712703] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.712990] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.767891] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ab93700e-8f41-4ebe-9364-250718a39119 None None] Enqueued Resource ID: e2cc01da-1102-4081-922a-8f2a2314722c with Priority: HIGHEST for action port [ 622.769278] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cc01da-1102-4081-922a-8f2a2314722c with Priority: HIGHEST for action port [ 622.769476] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2cc01da-1102-4081-922a-8f2a2314722c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.770703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2cc01da-1102-4081-922a-8f2a2314722c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.770703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2cc01da-1102-4081-922a-8f2a2314722c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.770703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2cc01da-1102-4081-922a-8f2a2314722c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.770703] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cc01da-1102-4081-922a-8f2a2314722c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.952978] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: SUCCESS [ 622.953228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.953543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.953637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.953837] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.954042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.954136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.954375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.954503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.954648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.954798] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.143939] env[65973]: INFO networking_nsxv3.common.synchronization [None req-da526c07-b098-43fd-b63e-474c028546a8 None None] Enqueued Resource ID: fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874 with Priority: HIGHEST for action port [ 623.144529] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874 with Priority: HIGHEST for action port [ 623.144915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.145161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.145265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.145563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.145650] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.272466] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2cc01da-1102-4081-922a-8f2a2314722c [ 623.272766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.272950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.273053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.273297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.273432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.273755] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2cc01da-1102-4081-922a-8f2a2314722c already deleted. [ 623.273755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2cc01da-1102-4081-922a-8f2a2314722c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.440155] env[65973]: INFO networking_nsxv3.common.synchronization [req-95e37dbc-6a74-41bb-812e-b5ae2e37714f req-768c7b5a-5e78-4a52-b066-9790a98f021b service nova] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 623.440372] env[65973]: INFO networking_nsxv3.common.synchronization [req-95e37dbc-6a74-41bb-812e-b5ae2e37714f req-768c7b5a-5e78-4a52-b066-9790a98f021b service nova] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 623.440522] env[65973]: INFO networking_nsxv3.common.synchronization [req-95e37dbc-6a74-41bb-812e-b5ae2e37714f req-768c7b5a-5e78-4a52-b066-9790a98f021b service nova] Enqueued Resource ID: 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 with Priority: HIGHEST for action port [ 623.441579] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 623.441808] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 623.441967] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 with Priority: HIGHEST for action port [ 623.442313] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.442453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.442562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.442812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.442926] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.444606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.444842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.444979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.445295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.445940] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.446114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.446236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.446469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.446594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.446750] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.448074] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.448074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.448074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.448267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.448267] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ed9ffd-d548-4a58-98fe-5dd21880a0a3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.461752] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.648667] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874 [ 623.650398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.650398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.650398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.650398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.650398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.650398] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874 already deleted. [ 623.650799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf3bee7-8d9f-4c3b-bfc8-45a259eaf874" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.706036] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 623.706469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.950465] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.950638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.950841] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.951886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 with status ACTIVE [ 623.952939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.952939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.952939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.952939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.952939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.952939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.952939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.953696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.953936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.954069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.955063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.955063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.955063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.955063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.955063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.955063] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87ed9ffd-d548-4a58-98fe-5dd21880a0a3 is going to be updated. [ 623.964612] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220a57f2-5c8d-419c-a2ca-41341c0360f6: rpc.has_security_group_logging(os_id): False [ 623.986862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.987179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.987179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.987340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.987581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.987757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87ed9ffd-d548-4a58-98fe-5dd21880a0a3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.988990] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.989174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.989240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.989623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.989623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.990045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.990045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.990327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.990395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.990485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.990597] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 is going to be created. [ 624.082350] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.082575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.082679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.083104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.083348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.100238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: IN_PROGRESS for 2s [ 624.109873] env[65973]: INFO networking_nsxv3.common.synchronization [req-42580df0-893b-401f-85d0-3b9164cf6043 req-e8bb92e8-e43d-4374-b513-3fe9fdb443cf tempest-ServerExternalEventsTest-1621717240 tempest-ServerExternalEventsTest-1621717240-project-member] Enqueued Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 624.111697] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGHEST for action security_group_members [ 624.114576] env[65973]: INFO networking_nsxv3.common.synchronization [req-c7fe7142-1b9b-4921-b610-a582ce97c2c5 req-a4b10313-7a8f-4f10-9ffb-089b706cf30b tempest-DeleteServersAdminTestJSON-909537065 tempest-DeleteServersAdminTestJSON-909537065-project-admin] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 624.114576] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.114576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.114576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.114576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.114966] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.115117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.115178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.115375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.116715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.116715] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.117361] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 624.119107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.119107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.119107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.119107] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.447387] env[65973]: INFO networking_nsxv3.common.synchronization [req-6666eaf9-25df-4e30-8643-51001b447ca1 req-21114c89-f9c8-4876-8f1c-e3e8dda1f01d tempest-TenantUsagesTestJSON-444332243 tempest-TenantUsagesTestJSON-444332243-project-member] Enqueued Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 624.448420] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGHEST for action security_group_members [ 624.448420] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.448420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.448770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.448770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.448845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.450767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.450767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.451058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.451058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.451058] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.459566] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.614143] env[65973]: INFO networking_nsxv3.common.synchronization [req-4d61d773-f9ca-49b4-aa7e-6326d67ce335 req-0d5fe979-de18-47a7-934f-80d2dd4a046f tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 624.615246] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 624.615996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.616163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.616398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.616771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.617021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.617109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.617481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.617481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.617481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.617672] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.619287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.619431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.619498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.619904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.620026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.620268] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.620354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.620394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.620693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.620787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.620888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe is going to be updated. [ 624.623781] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.623781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.623781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.623981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.623981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.624110] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.624210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.624268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.624418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.624494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.624582] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be updated. [ 624.677410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.677613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.677757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.678022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.678184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.679994] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.682593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.682698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.682989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.683158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.696471] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: IN_PROGRESS for 2s [ 624.697292] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 624.955353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.955470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.956668] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.956668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.956668] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb is going to be updated. [ 624.967193] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.967193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.967193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.967193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.967193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.967193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be created. [ 625.008838] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.008988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.009071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.009290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.009489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.021740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.021814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.022059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.022212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.028045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: UNINITIALIZED for 2s [ 625.040735] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: IN_PROGRESS for 2s [ 625.045816] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.045816] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.045816] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.046094] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.046555] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.046746] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.046829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.048099] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.048099] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.048099] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.048099] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.048099] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.048099] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.048099] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.048099] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.048099] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.100561] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.100758] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.100893] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.101106] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.101431] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-ddc921ad-b656-4963-82c6-70d00956ed82 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.101725] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.101725] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.102088] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.102227] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc921ad-b656-4963-82c6-70d00956ed82',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.124628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.125193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.125193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.125371] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.125454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.125611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.125706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.125792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.125930] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 already deleted. [ 625.125930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.605631] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.606102] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.606280] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.607365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.607574] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.609555] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port ddc921ad-b656-4963-82c6-70d00956ed82 not found, creating... [ 625.609978] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.610192] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.610309] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.610587] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.610727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.611082] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.611260] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.611369] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.611608] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.611738] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.611874] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: ddc921ad-b656-4963-82c6-70d00956ed82 is going to be created. [ 625.638450] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.638685] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.638768] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.639092] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.639324] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.639549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.982583] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ccb8c1d9-a6eb-4d60-9080-bb546484b15b None None] Enqueued Resource ID: cf013c25-8bd2-4856-8776-658e7b10f312 with Priority: HIGHEST for action port [ 625.986024] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf013c25-8bd2-4856-8776-658e7b10f312 with Priority: HIGHEST for action port [ 625.986024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf013c25-8bd2-4856-8776-658e7b10f312 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.986024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf013c25-8bd2-4856-8776-658e7b10f312" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.986024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf013c25-8bd2-4856-8776-658e7b10f312" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.986024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf013c25-8bd2-4856-8776-658e7b10f312" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.986024] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf013c25-8bd2-4856-8776-658e7b10f312',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.119179] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: SUCCESS [ 626.119346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [req-4d61d773-f9ca-49b4-aa7e-6326d67ce335 req-a2ef5c51-eb17-42ef-ab43-cf4b57b1c903 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [req-4d61d773-f9ca-49b4-aa7e-6326d67ce335 req-a2ef5c51-eb17-42ef-ab43-cf4b57b1c903 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [req-4d61d773-f9ca-49b4-aa7e-6326d67ce335 req-a2ef5c51-eb17-42ef-ab43-cf4b57b1c903 service nova] Enqueued Resource ID: ddc921ad-b656-4963-82c6-70d00956ed82 with Priority: HIGHEST for action port [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 626.446857] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc921ad-b656-4963-82c6-70d00956ed82 with Priority: HIGHEST for action port [ 626.446857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.446857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.446857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.446857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.447339] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.447925] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.448074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.448126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.448308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.448511] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.448559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.448709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.448751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.448863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.448957] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.450186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc921ad-b656-4963-82c6-70d00956ed82 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.450308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.450373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.450592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.450670] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc921ad-b656-4963-82c6-70d00956ed82',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.488101] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf013c25-8bd2-4856-8776-658e7b10f312 [ 626.488344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.488479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.488540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.488809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.488915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.489030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf013c25-8bd2-4856-8776-658e7b10f312 already deleted. [ 626.489171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf013c25-8bd2-4856-8776-658e7b10f312" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.710055] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 626.710807] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 deletion is rescheduled due to dependency. [ 626.711049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.711897] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe in Status: SUCCESS [ 626.712168] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe deletion is rescheduled due to dependency. [ 626.712782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.954568] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.955786] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.955786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.955786] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddc921ad-b656-4963-82c6-70d00956ed82 with status ACTIVE [ 626.955786] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.955786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.955786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.956130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.956259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.956307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.956415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.956553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.958034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.958034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.958034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.958034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.958034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.958034] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddc921ad-b656-4963-82c6-70d00956ed82 is going to be updated. [ 626.990552] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.990552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.990552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.990552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.990552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.990552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc921ad-b656-4963-82c6-70d00956ed82" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.044501] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 627.044501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.044501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.044501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.045018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.045121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.045158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.045838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.045838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.045954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.046100] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.058360] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb in Status: SUCCESS [ 627.060252] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb deletion is rescheduled due to dependency. [ 627.060252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.247628] env[65973]: INFO networking_nsxv3.common.synchronization [req-794ba404-3979-4e8e-ba30-8409e0109461 req-df68a607-1685-49a1-b711-609097e15c45 tempest-ServerAddressesNegativeTestJSON-125459746 tempest-ServerAddressesNegativeTestJSON-125459746-project-member] Enqueued Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 627.248204] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 627.249617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.249617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.250230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.250460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.250632] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.456394] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.552547] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.755845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.756245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.756245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.756478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.756570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.756788] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.756903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.756983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.757200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.757272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.757358] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 already deleted. [ 627.757436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.958431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.958576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.959288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.959288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.959288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.959288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be created. [ 627.985568] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.985711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.985796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.986015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.986181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.998266] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: UNINITIALIZED for 2s [ 628.056877] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c: rpc.has_security_group_logging(os_id): False [ 628.073955] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.074178] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-183" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.074399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-183" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.074889] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-183" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.075484] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.075610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.075803] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.076014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.077289] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.077289] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.077289] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.077289] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.077289] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.077289] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.077289] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.077561] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.090265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.090265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.090265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.090265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.090265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.090265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.093686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.093686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.093686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.093686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.093686] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be created. [ 628.111614] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.111761] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.111998] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.112252] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-183" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.112999] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-a7415db1-08c6-44fd-9475-16799b636d2f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.112999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.112999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.113257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.113336] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7415db1-08c6-44fd-9475-16799b636d2f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.170209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.170209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.170209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.170209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.170209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182646] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 628.616645] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.616864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.617008] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.617317] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.617466] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.617684] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port a7415db1-08c6-44fd-9475-16799b636d2f not found, creating... [ 628.618050] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.618253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.618384] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.618609] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.618790] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.619688] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.619887] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.620013] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.620481] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.621123] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.621123] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: a7415db1-08c6-44fd-9475-16799b636d2f is going to be created. [ 628.624452] env[65973]: INFO networking_nsxv3.common.synchronization [None req-0194e595-dc53-4961-b799-0fcd1c20898b None None] Enqueued Resource ID: 93115421-c67e-47a0-a0af-d2a159c2915f with Priority: HIGHEST for action port [ 628.625415] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93115421-c67e-47a0-a0af-d2a159c2915f with Priority: HIGHEST for action port [ 628.625712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-93115421-c67e-47a0-a0af-d2a159c2915f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.626042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93115421-c67e-47a0-a0af-d2a159c2915f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.626156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93115421-c67e-47a0-a0af-d2a159c2915f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.626639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93115421-c67e-47a0-a0af-d2a159c2915f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.626875] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93115421-c67e-47a0-a0af-d2a159c2915f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.645327] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.645696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.645943] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.646527] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.646792] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.647196] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.130056] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93115421-c67e-47a0-a0af-d2a159c2915f [ 629.130384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.130477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.130526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.130738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.130831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.130935] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93115421-c67e-47a0-a0af-d2a159c2915f already deleted. [ 629.131035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93115421-c67e-47a0-a0af-d2a159c2915f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.401126] env[65973]: INFO networking_nsxv3.common.synchronization [req-794ba404-3979-4e8e-ba30-8409e0109461 req-c6261b9f-d755-4fe1-ad21-6810961215d0 service nova] Enqueued Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_rules [ 629.401126] env[65973]: INFO networking_nsxv3.common.synchronization [req-794ba404-3979-4e8e-ba30-8409e0109461 req-c6261b9f-d755-4fe1-ad21-6810961215d0 service nova] Enqueued Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 629.401126] env[65973]: INFO networking_nsxv3.common.synchronization [req-794ba404-3979-4e8e-ba30-8409e0109461 req-c6261b9f-d755-4fe1-ad21-6810961215d0 service nova] Enqueued Resource ID: a7415db1-08c6-44fd-9475-16799b636d2f with Priority: HIGHEST for action port [ 629.401624] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_rules [ 629.401763] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 629.401861] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7415db1-08c6-44fd-9475-16799b636d2f with Priority: HIGHEST for action port [ 629.402190] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.402306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.402371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.402677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.402711] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.403642] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.403773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.403822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.403975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.404130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.404276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.404276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.404276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.406296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.406436] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.410019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7415db1-08c6-44fd-9475-16799b636d2f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.410019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.410019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.410019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.410019] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7415db1-08c6-44fd-9475-16799b636d2f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.912151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7415db1-08c6-44fd-9475-16799b636d2f with status ACTIVE [ 629.912462] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.912697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.912697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.912881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.912970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.913158] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.913927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.914010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.914610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.914797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.915256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.918702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.918844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.919058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.919265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.919326] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7415db1-08c6-44fd-9475-16799b636d2f is going to be updated. [ 629.920622] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.920734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.920932] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.956713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.956983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.956983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.957209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.957353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.957520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7415db1-08c6-44fd-9475-16799b636d2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.017406] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 630.017620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.017812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.018107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.018353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.018595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.018595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.019420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.019420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.019420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.019420] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.196378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 630.196735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.423103] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.529030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.529030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.529030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.529030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.529030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.529724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.529724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.529724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.529724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.529724] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.749349] env[65973]: INFO networking_nsxv3.common.synchronization [None req-47f7d8ad-9c11-4038-8215-369eba915710 None None] Enqueued Resource ID: 2e47c050-bf7e-49c7-bd7e-518e301a40f1 with Priority: HIGHEST for action port [ 630.749349] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e47c050-bf7e-49c7-bd7e-518e301a40f1 with Priority: HIGHEST for action port [ 630.752408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e47c050-bf7e-49c7-bd7e-518e301a40f1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e47c050-bf7e-49c7-bd7e-518e301a40f1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e47c050-bf7e-49c7-bd7e-518e301a40f1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.753229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e47c050-bf7e-49c7-bd7e-518e301a40f1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.753313] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e47c050-bf7e-49c7-bd7e-518e301a40f1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.929390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.929390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.929390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.929390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.929390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.929390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 is going to be created. [ 630.955469] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.955673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.955673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.956085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.957353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.969779] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: UNINITIALIZED for 2s [ 631.031962] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 631.057049] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.057294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.057294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.058103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.058264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.058499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.058610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.058678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.058920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.058968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.059212] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.059308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.059368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.059506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.059757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.059757] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.060084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.060084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.060360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.060360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.060360] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be created. [ 631.131228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.131228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.131228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.131228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.131228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.147260] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 631.256255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e47c050-bf7e-49c7-bd7e-518e301a40f1 [ 631.256567] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.256567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.256567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.256794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.256832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.257393] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e47c050-bf7e-49c7-bd7e-518e301a40f1 already deleted. [ 631.257393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e47c050-bf7e-49c7-bd7e-518e301a40f1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.700296] env[65973]: INFO networking_nsxv3.common.synchronization [None req-25261350-8f64-41c8-9227-cdf3a2ad6cf4 None None] Enqueued Resource ID: df8e462e-a609-422b-9fb5-e0b16f24ebb7 with Priority: HIGHEST for action port [ 632.702410] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8e462e-a609-422b-9fb5-e0b16f24ebb7 with Priority: HIGHEST for action port [ 632.702410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-df8e462e-a609-422b-9fb5-e0b16f24ebb7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.702670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df8e462e-a609-422b-9fb5-e0b16f24ebb7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.702670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df8e462e-a609-422b-9fb5-e0b16f24ebb7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.703158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df8e462e-a609-422b-9fb5-e0b16f24ebb7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.703234] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df8e462e-a609-422b-9fb5-e0b16f24ebb7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.984358] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: SUCCESS [ 632.985187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.985629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.986196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.986662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.989144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.989144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.989144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.989144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.989144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.989144] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.162080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 633.162323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.207603] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df8e462e-a609-422b-9fb5-e0b16f24ebb7 [ 633.207889] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.211597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.211597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.211597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.211597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.211847] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df8e462e-a609-422b-9fb5-e0b16f24ebb7 already deleted. [ 633.211847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df8e462e-a609-422b-9fb5-e0b16f24ebb7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.492632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.492868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.492981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.494359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.494359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.494359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.494814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.494814] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.494814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.494814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.494945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.495041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.495130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.495222] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.000066] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4: rpc.has_security_group_logging(os_id): False [ 634.020416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.021348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.021713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.022281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.022505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.022853] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.023101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.023412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.023779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.026610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.026610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.026610] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 is going to be created. [ 634.092020] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.092020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.092020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.092020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.092020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.103546] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: IN_PROGRESS for 2s [ 634.543701] env[65973]: INFO networking_nsxv3.common.synchronization [None req-19a18c6b-c182-42c9-832c-0bd26ada6d91 None None] Enqueued Resource ID: 1978566b-8e18-454c-b146-baa1e3718981 with Priority: HIGHEST for action port [ 634.543930] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1978566b-8e18-454c-b146-baa1e3718981 with Priority: HIGHEST for action port [ 634.547433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1978566b-8e18-454c-b146-baa1e3718981 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.547433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1978566b-8e18-454c-b146-baa1e3718981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.547433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1978566b-8e18-454c-b146-baa1e3718981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.547433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1978566b-8e18-454c-b146-baa1e3718981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.547433] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1978566b-8e18-454c-b146-baa1e3718981',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.049408] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1978566b-8e18-454c-b146-baa1e3718981 [ 635.049667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.049872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.049872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.050213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.052701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.052701] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1978566b-8e18-454c-b146-baa1e3718981 already deleted. [ 635.052701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1978566b-8e18-454c-b146-baa1e3718981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.120195] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: SUCCESS [ 636.120195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.548219] env[65973]: INFO networking_nsxv3.common.synchronization [req-90e9b7ac-60b0-456f-818b-586f3b85ad02 req-a8040ad2-ce2d-49ea-9884-f56efd58c3e1 tempest-ListImageFiltersTestJSON-302671947 tempest-ListImageFiltersTestJSON-302671947-project-member] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 638.549499] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 638.554043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.554043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.554043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.554043] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.589443] env[65973]: INFO networking_nsxv3.common.synchronization [None req-66cf3d37-a3ca-4d05-8828-1e111b8e6ea4 None None] Enqueued Resource ID: 26a096fc-ec01-4261-91a3-497f9a744654 with Priority: HIGHEST for action port [ 638.590684] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26a096fc-ec01-4261-91a3-497f9a744654 with Priority: HIGHEST for action port [ 638.591016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-26a096fc-ec01-4261-91a3-497f9a744654 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.591154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26a096fc-ec01-4261-91a3-497f9a744654" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.591219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26a096fc-ec01-4261-91a3-497f9a744654" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.591488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26a096fc-ec01-4261-91a3-497f9a744654" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.591563] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26a096fc-ec01-4261-91a3-497f9a744654',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.953431] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.953625] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.953744] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.954016] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.954279] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.954428] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.954537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.954744] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.954879] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.955096] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.955204] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.955307] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.955405] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.955506] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.955605] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.955723] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.978303] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.978505] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.978605] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.978771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.979158] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.979313] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.979558] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.979902] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.980135] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1dc4f2-808a-4a54-91cb-62ea52a99fb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.057000] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.057000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.057185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.057446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.057601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.058145] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.058145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.058145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.058369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.058481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.058696] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 already deleted. [ 639.058766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.094301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26a096fc-ec01-4261-91a3-497f9a744654 [ 639.096659] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.096659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.096659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.096659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.096659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.096659] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26a096fc-ec01-4261-91a3-497f9a744654 already deleted. [ 639.096659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26a096fc-ec01-4261-91a3-497f9a744654" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.223518] env[65973]: INFO networking_nsxv3.common.synchronization [req-3b540a76-32e7-424b-814d-0ad11d6e9738 req-c6dd91e5-10ba-4f2c-abac-d8d1685c43a8 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 639.224096] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 639.224411] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.224543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.224687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.224805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.224959] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.225081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.225143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.225295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.225382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.225473] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.470423] env[65973]: INFO networking_nsxv3.common.synchronization [req-d029de87-312a-440d-8c96-0783be86d607 req-c94fd910-f7f6-464f-bc54-18230971b73b tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 639.470917] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 639.473778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe206044-fd8e-4b78-abf5-253de39bc912 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.474062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.474244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.474600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.474742] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe206044-fd8e-4b78-abf5-253de39bc912',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.483312] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.483516] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.483635] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.483915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.484088] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.484216] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 not found, creating... [ 639.484561] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.484692] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.484800] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.485056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.485189] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.485462] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.485629] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.485737] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.485959] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.486308] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.486888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 is going to be created. [ 639.524478] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.524703] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.524829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.525119] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.525343] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.525557] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.728517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.728822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.728822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.729024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.729104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.729496] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.729496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.729496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.729665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.729699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.729763] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 639.763795] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.764142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.764233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.764479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.764665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.776025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 639.999590] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.999590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.999590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.000267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.000405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.000529] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe206044-fd8e-4b78-abf5-253de39bc912 already deleted. [ 640.000641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.195508] env[65973]: INFO networking_nsxv3.common.synchronization [req-fb526f44-11d0-446b-bfbb-5288d8ddf4ae req-d2aa0e41-c9ff-42ed-8b57-ea4a5e5cbb4d tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 640.196204] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 640.196437] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.196547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.197163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.198082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.198324] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.198444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.198511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.198685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.198770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.198865] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.282316] env[65973]: INFO networking_nsxv3.common.synchronization [req-90e9b7ac-60b0-456f-818b-586f3b85ad02 req-bc1ad466-07dd-4895-a62a-6850d17e9854 service nova] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_rules [ 640.282484] env[65973]: INFO networking_nsxv3.common.synchronization [req-90e9b7ac-60b0-456f-818b-586f3b85ad02 req-bc1ad466-07dd-4895-a62a-6850d17e9854 service nova] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 640.282610] env[65973]: INFO networking_nsxv3.common.synchronization [req-90e9b7ac-60b0-456f-818b-586f3b85ad02 req-bc1ad466-07dd-4895-a62a-6850d17e9854 service nova] Enqueued Resource ID: 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 with Priority: HIGHEST for action port [ 640.283272] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_rules [ 640.283272] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 640.283272] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 with Priority: HIGHEST for action port [ 640.283567] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.283691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.283758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.284008] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.285558] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.286667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.288012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.288130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.288351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.289732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.289732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.289732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.289732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.289732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.289732] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.291130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.291130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.291130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.291344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.291393] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1dc4f2-808a-4a54-91cb-62ea52a99fb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.406246] env[65973]: INFO networking_nsxv3.common.synchronization [None req-0bf0afc4-97e9-4667-8f74-4abbcb596287 None None] Enqueued Resource ID: 2843ac9c-b316-4f0d-83a1-61f3c15d045f with Priority: HIGHEST for action port [ 640.406534] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2843ac9c-b316-4f0d-83a1-61f3c15d045f with Priority: HIGHEST for action port [ 640.406891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2843ac9c-b316-4f0d-83a1-61f3c15d045f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.407054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2843ac9c-b316-4f0d-83a1-61f3c15d045f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.407054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2843ac9c-b316-4f0d-83a1-61f3c15d045f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.407283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2843ac9c-b316-4f0d-83a1-61f3c15d045f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.407360] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2843ac9c-b316-4f0d-83a1-61f3c15d045f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.625183] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.625426] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.625564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.625839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.626115] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.626299] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.626384] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.626580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.626781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.626947] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.627022] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.627139] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.627214] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.627302] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.627403] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.627526] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.660230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.660629] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.660889] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.661173] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.661823] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-c06e02e0-9f0e-48ad-bbac-36f90accb605 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.662415] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.662634] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.663071] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.663346] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c06e02e0-9f0e-48ad-bbac-36f90accb605',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.701216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.701364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.701715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.701715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.701838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.701914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.702035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.702098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.702937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.702937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.702937] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e already deleted. [ 640.702937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.795577] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.795577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.795577] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.796570] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 with status ACTIVE [ 640.797827] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.797827] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.797827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.798493] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.798493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.798493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.798611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.798826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.798826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a1dc4f2-808a-4a54-91cb-62ea52a99fb1 is going to be updated. [ 640.826060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.826317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.826451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.826624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.826770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.826973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a1dc4f2-808a-4a54-91cb-62ea52a99fb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.909997] env[65973]: INFO networking_nsxv3.common.synchronization [None req-173acd36-8970-4160-92e4-2c388528e7fc None None] Enqueued Resource ID: b9cf582a-e1b0-40a6-a8e2-8f9f9a742460 with Priority: HIGHEST for action port [ 640.910473] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2843ac9c-b316-4f0d-83a1-61f3c15d045f [ 640.911484] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.911484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.911484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.911484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.911484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.911484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2843ac9c-b316-4f0d-83a1-61f3c15d045f already deleted. [ 640.911484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2843ac9c-b316-4f0d-83a1-61f3c15d045f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.912344] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cf582a-e1b0-40a6-a8e2-8f9f9a742460 with Priority: HIGHEST for action port [ 640.912344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9cf582a-e1b0-40a6-a8e2-8f9f9a742460 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.912509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9cf582a-e1b0-40a6-a8e2-8f9f9a742460" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.912509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9cf582a-e1b0-40a6-a8e2-8f9f9a742460" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.912850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9cf582a-e1b0-40a6-a8e2-8f9f9a742460" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.912927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9cf582a-e1b0-40a6-a8e2-8f9f9a742460',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.167575] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.167843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.168010] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.168311] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.168460] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.168819] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port c06e02e0-9f0e-48ad-bbac-36f90accb605 not found, creating... [ 641.168923] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.169051] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.169237] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.169359] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.169467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.169740] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.169899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.170019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.170231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.170404] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.170540] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: c06e02e0-9f0e-48ad-bbac-36f90accb605 is going to be created. [ 641.193243] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.193400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.193509] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.194105] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.194105] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.194262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.301269] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.416122] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9cf582a-e1b0-40a6-a8e2-8f9f9a742460 [ 641.416455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.416703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.416703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.417179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.417179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.417179] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9cf582a-e1b0-40a6-a8e2-8f9f9a742460 already deleted. [ 641.417179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9cf582a-e1b0-40a6-a8e2-8f9f9a742460" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.789025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 641.789575] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 641.789575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.807009] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.807430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.807430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.807545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.807545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.807638] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be created. [ 641.832854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.832854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.832854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.832854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.833243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.843134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: UNINITIALIZED for 2s [ 642.331694] env[65973]: INFO networking_nsxv3.common.synchronization [req-fb526f44-11d0-446b-bfbb-5288d8ddf4ae req-51c0ba5c-9306-44ab-80c8-ae8f3ce4daba service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 642.331694] env[65973]: INFO networking_nsxv3.common.synchronization [req-fb526f44-11d0-446b-bfbb-5288d8ddf4ae req-51c0ba5c-9306-44ab-80c8-ae8f3ce4daba service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 642.331694] env[65973]: INFO networking_nsxv3.common.synchronization [req-fb526f44-11d0-446b-bfbb-5288d8ddf4ae req-51c0ba5c-9306-44ab-80c8-ae8f3ce4daba service nova] Enqueued Resource ID: c06e02e0-9f0e-48ad-bbac-36f90accb605 with Priority: HIGHEST for action port [ 642.332296] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 642.332486] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 642.332486] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06e02e0-9f0e-48ad-bbac-36f90accb605 with Priority: HIGHEST for action port [ 642.332816] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.334166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.334166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.334166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.334166] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.335022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.335137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.335137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.335306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.335444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.335532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.335691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.335745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.335789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.335875] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.336625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c06e02e0-9f0e-48ad-bbac-36f90accb605 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.336760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.336822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.337308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.337308] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c06e02e0-9f0e-48ad-bbac-36f90accb605',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.839779] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.840097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.840138] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.842150] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c06e02e0-9f0e-48ad-bbac-36f90accb605 with status ACTIVE [ 642.842348] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.842511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.842575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.842791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.842858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.843019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.843700] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.843700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.844092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.844092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.844092] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c06e02e0-9f0e-48ad-bbac-36f90accb605 is going to be updated. [ 642.872988] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.873178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.873227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.873423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.873555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.873716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c06e02e0-9f0e-48ad-bbac-36f90accb605" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.346993] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.851655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.851655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.851655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.851655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.851655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.851655] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be created. [ 643.854778] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 643.854888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.855157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.855378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.855577] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.855699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.855766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.855970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.856119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.856212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.856513] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.880258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.880455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.880455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.880602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.880762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.893540] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: UNINITIALIZED for 2s [ 644.050490] env[65973]: INFO networking_nsxv3.common.synchronization [None req-bcf5ad3b-b60d-45b1-944b-44300d5b31b6 None None] Enqueued Resource ID: c71d76ea-eb31-4f4c-a072-5590164cfba8 with Priority: HIGHEST for action port [ 644.051986] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c71d76ea-eb31-4f4c-a072-5590164cfba8 with Priority: HIGHEST for action port [ 644.054069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c71d76ea-eb31-4f4c-a072-5590164cfba8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.054069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c71d76ea-eb31-4f4c-a072-5590164cfba8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.054069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c71d76ea-eb31-4f4c-a072-5590164cfba8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.054069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c71d76ea-eb31-4f4c-a072-5590164cfba8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.054069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c71d76ea-eb31-4f4c-a072-5590164cfba8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.138615] env[65973]: INFO networking_nsxv3.common.synchronization [req-7afefb3f-8bdb-44ad-be3f-d6d4ea702af4 req-a8634a97-2fec-4280-8a2e-361f5740e8d4 tempest-FloatingIPsAssociationTestJSON-1939154346 tempest-FloatingIPsAssociationTestJSON-1939154346-project-member] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 644.139315] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 644.139624] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.139741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.139818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.140182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.140348] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.140438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.140489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.140794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.140885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.141512] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.360679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.361967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.361967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.361967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.362162] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.362508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.362508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.362635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.362685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.364711] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.364711] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.364711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.364711] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.557584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c71d76ea-eb31-4f4c-a072-5590164cfba8 [ 644.557584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.557584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.557584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.557584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.557584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.557584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c71d76ea-eb31-4f4c-a072-5590164cfba8 already deleted. [ 644.557584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c71d76ea-eb31-4f4c-a072-5590164cfba8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.630026] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.630026] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.630026] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.630026] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.630558] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.630905] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.631163] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.631526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.631815] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.632169] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.632445] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.632685] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.632916] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.633595] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.633595] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.633595] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.645293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.645439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.645518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.645748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.645833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.646044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.646157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.646222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.646387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.646474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.646556] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 already deleted. [ 644.646646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.654715] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.654904] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.655071] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.655293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.655639] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-1c80ee99-9137-49d0-a739-c08ab02ad77d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.656022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.656402] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.656578] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c80ee99-9137-49d0-a739-c08ab02ad77d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.866940] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b841c0a-397f-4e9d-b02d-5feeaebf26a7: rpc.has_security_group_logging(os_id): False [ 644.887401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.887687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.887736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.888027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.888145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.888405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.888549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.888627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.888844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.889187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.890296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.890442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.890524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.890742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.890867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.891128] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.891257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.891397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.891477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.892341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.892341] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be created. [ 644.957389] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.957628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.957691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.958072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.958308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.974455] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 645.159573] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.159828] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.159960] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.160655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.160655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.160826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 1c80ee99-9137-49d0-a739-c08ab02ad77d not found, creating... [ 645.161316] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.161431] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.161431] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.165070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.165343] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.165756] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.166190] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.166273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.166701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.166701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.166808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 1c80ee99-9137-49d0-a739-c08ab02ad77d is going to be created. [ 645.190016] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.190264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.190383] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.190662] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.191145] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.191145] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.301061] env[65973]: INFO networking_nsxv3.common.synchronization [req-c01c4bec-536e-4da8-a785-c71b41be66f9 req-f2d55061-6634-422a-aedf-981e3c45af84 tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 645.301738] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 645.302071] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe206044-fd8e-4b78-abf5-253de39bc912 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.302289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.302367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.302612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.302721] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe206044-fd8e-4b78-abf5-253de39bc912',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.540829] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b0fa7682-395d-4031-b0c5-ca0f93cd8f9a None None] Enqueued Resource ID: 027791e8-450e-410a-841b-103de3f6bc0c with Priority: HIGHEST for action port [ 645.541706] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 027791e8-450e-410a-841b-103de3f6bc0c with Priority: HIGHEST for action port [ 645.541915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-027791e8-450e-410a-841b-103de3f6bc0c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.542048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-027791e8-450e-410a-841b-103de3f6bc0c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.542107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-027791e8-450e-410a-841b-103de3f6bc0c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.543419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-027791e8-450e-410a-841b-103de3f6bc0c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.543419] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027791e8-450e-410a-841b-103de3f6bc0c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.826824] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.827713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.827815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.828107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.828200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.828999] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe206044-fd8e-4b78-abf5-253de39bc912 already deleted. [ 645.828999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.903932] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 645.904261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.904493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.904578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.904752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.904860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.904916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.905285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.905425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.905643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.905643] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.977336] env[65973]: INFO networking_nsxv3.common.synchronization [req-7afefb3f-8bdb-44ad-be3f-d6d4ea702af4 req-8a9d93e8-d3a8-4d3c-8ef6-d8c5d9950975 service nova] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_rules [ 645.977336] env[65973]: INFO networking_nsxv3.common.synchronization [req-7afefb3f-8bdb-44ad-be3f-d6d4ea702af4 req-8a9d93e8-d3a8-4d3c-8ef6-d8c5d9950975 service nova] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 645.977336] env[65973]: INFO networking_nsxv3.common.synchronization [req-7afefb3f-8bdb-44ad-be3f-d6d4ea702af4 req-8a9d93e8-d3a8-4d3c-8ef6-d8c5d9950975 service nova] Enqueued Resource ID: 1c80ee99-9137-49d0-a739-c08ab02ad77d with Priority: HIGHEST for action port [ 645.977336] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_rules [ 645.977588] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 645.977882] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c80ee99-9137-49d0-a739-c08ab02ad77d with Priority: HIGHEST for action port [ 645.978044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.978259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.978310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.978749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.978835] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.980970] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.980970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.980970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.982154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.982480] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.982480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.982627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.982725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.982765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.983136] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.983946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c80ee99-9137-49d0-a739-c08ab02ad77d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.983946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.983946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.984140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.984185] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c80ee99-9137-49d0-a739-c08ab02ad77d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.044413] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 027791e8-450e-410a-841b-103de3f6bc0c [ 646.044689] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.044828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.044924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.045140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.045233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.045335] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:027791e8-450e-410a-841b-103de3f6bc0c already deleted. [ 646.045476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-027791e8-450e-410a-841b-103de3f6bc0c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.191063] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9c6d262-2bf6-4108-955d-962d560e0fd3 req-cfcb33e7-fe54-4cc5-b984-2fd23efafabb tempest-ListImageFiltersTestJSON-302671947 tempest-ListImageFiltersTestJSON-302671947-project-member] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 646.191063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 646.191063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.191063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.191063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.191063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.191063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.191063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.191063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.191806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.191806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.191806] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.411394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.411394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.411394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.411394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.411585] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.411585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.411679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.411864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.411977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.412117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.412331] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.412457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.412540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.412729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.412913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.413070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.413507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.413887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.414070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.414233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.414646] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.485916] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.486226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.486461] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.487522] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c80ee99-9137-49d0-a739-c08ab02ad77d with status ACTIVE [ 646.488519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.488519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.488519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.488519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.488922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.489185] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.489353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.490078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.490078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.490078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.491078] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.491078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.491078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.491078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.491324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.491507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c80ee99-9137-49d0-a739-c08ab02ad77d is going to be updated. [ 646.520570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.520783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.520856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.521117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.521273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.522612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c80ee99-9137-49d0-a739-c08ab02ad77d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.698562] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.804021] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.804021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.804021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.804021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.804300] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.804490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.804597] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.804881] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.808015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.808015] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.808015] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.808015] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.808015] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.808015] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.808015] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.808015] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.825347] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.825347] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.825347] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.825665] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.825754] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.825942] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.826244] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.826413] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.827030] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.918719] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12bf28a0-51ca-4171-b63e-ba9ad7a0139e: rpc.has_security_group_logging(os_id): False [ 646.946610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.946844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.946955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.947291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.947446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.947738] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.948724] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.948724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.948962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.948962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.949477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.949542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.949616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.949785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.949891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.950017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be created. [ 646.986780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 646.988074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.994962] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.015471] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.015681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.015681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.015857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.016300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.030656] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 647.200787] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.329495] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.329720] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.329823] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.330133] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.330320] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.330490] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade not found, creating... [ 647.330776] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.330943] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.331074] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.331342] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.331435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.331696] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.331841] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.331947] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.332203] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.332333] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.332464] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade is going to be created. [ 647.354288] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.354561] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.354651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.354896] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.355150] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.355375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.498274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.498420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.498420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.498622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.498717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.498813] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be created. [ 647.527157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.527546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.527546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.527639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.527749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.540120] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: UNINITIALIZED for 2s [ 647.703883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.704127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.704188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.704497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.704595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.704698] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be updated. [ 647.736398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.737442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.737442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.737442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.737442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.754631] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 648.067090] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9c6d262-2bf6-4108-955d-962d560e0fd3 req-9fa09fcc-78b7-47a8-9e28-1095e75760ab service nova] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_rules [ 648.067090] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9c6d262-2bf6-4108-955d-962d560e0fd3 req-9fa09fcc-78b7-47a8-9e28-1095e75760ab service nova] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 648.067090] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9c6d262-2bf6-4108-955d-962d560e0fd3 req-9fa09fcc-78b7-47a8-9e28-1095e75760ab service nova] Enqueued Resource ID: 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade with Priority: HIGHEST for action port [ 648.067914] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_rules [ 648.067914] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 648.067914] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade with Priority: HIGHEST for action port [ 648.067914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.067914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.067914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.068357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.068357] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.069247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.069247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.070927] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.070927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.070927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.070927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.070927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.226663] env[65973]: INFO networking_nsxv3.common.synchronization [None req-6dbe358f-ba1c-4080-bb3b-f3bbd594a4b2 None None] Enqueued Resource ID: a7f6bd3c-fd54-4760-8818-d214aff435b0 with Priority: HIGHEST for action port [ 648.227207] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7f6bd3c-fd54-4760-8818-d214aff435b0 with Priority: HIGHEST for action port [ 648.228295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7f6bd3c-fd54-4760-8818-d214aff435b0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.228405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7f6bd3c-fd54-4760-8818-d214aff435b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.228474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7f6bd3c-fd54-4760-8818-d214aff435b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.229164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7f6bd3c-fd54-4760-8818-d214aff435b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.229261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f6bd3c-fd54-4760-8818-d214aff435b0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.572803] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.573397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.575982] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade with status ACTIVE [ 648.576189] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.576297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.576387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.576705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.577101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.577101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.577257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.577257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.577748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.577748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.577748] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.578096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.578096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.578096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.578327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.578327] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade is going to be updated. [ 648.600691] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.600846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.600967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.601136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.601273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.601436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb8d9aa-2ccb-4adc-bac9-2ee9ab3cdade" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.733128] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7f6bd3c-fd54-4760-8818-d214aff435b0 [ 648.733817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.733817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.733817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.733998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.733998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.734171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7f6bd3c-fd54-4760-8818-d214aff435b0 already deleted. [ 648.734171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7f6bd3c-fd54-4760-8818-d214aff435b0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.982436] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e6823f5a-883b-4336-bd74-42cf53c51789 None None] Enqueued Resource ID: 3d78836a-2ab0-47df-bc2a-9293159db580 with Priority: HIGHEST for action port [ 648.983699] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d78836a-2ab0-47df-bc2a-9293159db580 with Priority: HIGHEST for action port [ 648.987105] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d78836a-2ab0-47df-bc2a-9293159db580 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.987105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d78836a-2ab0-47df-bc2a-9293159db580" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.987105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d78836a-2ab0-47df-bc2a-9293159db580" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.987105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d78836a-2ab0-47df-bc2a-9293159db580" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.987105] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d78836a-2ab0-47df-bc2a-9293159db580',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.045660] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 649.045943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.490111] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d78836a-2ab0-47df-bc2a-9293159db580 [ 649.490111] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.490111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.490111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.490830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.490830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.490830] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d78836a-2ab0-47df-bc2a-9293159db580 already deleted. [ 649.490830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d78836a-2ab0-47df-bc2a-9293159db580" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.520575] env[65973]: INFO networking_nsxv3.common.synchronization [req-a63162c5-7ca3-48d7-bbcc-50779503d0b4 req-e21e2352-dcf3-4e25-b4e6-a0d780a9f60b tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 649.521200] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 649.521793] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.521955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.523539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.523539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.523539] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.523539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.523539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.523539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.524025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.524025] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.554099] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 649.555194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.555874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.556304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.556438] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.556545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.556545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.556792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.556941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.557227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.557227] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.753769] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c6d45208-b8c9-42e7-bf82-30214edf7200 None None] Enqueued Resource ID: 185ebe01-c9e3-49cb-9b2e-4541b46c0bcc with Priority: HIGHEST for action port [ 649.754375] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185ebe01-c9e3-49cb-9b2e-4541b46c0bcc with Priority: HIGHEST for action port [ 649.754812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-185ebe01-c9e3-49cb-9b2e-4541b46c0bcc taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.754970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-185ebe01-c9e3-49cb-9b2e-4541b46c0bcc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.755054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-185ebe01-c9e3-49cb-9b2e-4541b46c0bcc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.755374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-185ebe01-c9e3-49cb-9b2e-4541b46c0bcc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.755462] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('185ebe01-c9e3-49cb-9b2e-4541b46c0bcc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.768745] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 649.768745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.769284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.769350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.769503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.769615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.769675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.769839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.769969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.770058] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.027447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.060298] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.060506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.060506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.060901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.061102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.061206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.061262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.061431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.061518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.061603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.061756] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.061847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.061907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.062068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.062205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.062323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.062365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.062477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.062545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.062658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.062719] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.144458] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.145048] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.145048] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.146308] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.146903] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.147114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.147404] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.147700] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.148306] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.152033] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.152033] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.152033] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.152033] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.152033] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.152033] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.152033] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.169757] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.170085] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.170568] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.171443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.171443] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-63f9e194-33fa-4ffd-8c36-a0444c2481f9 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.171443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.172039] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.172039] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.172483] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f9e194-33fa-4ffd-8c36-a0444c2481f9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.259304] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 185ebe01-c9e3-49cb-9b2e-4541b46c0bcc [ 650.259848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.259848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.259848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.260012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.260075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.260138] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:185ebe01-c9e3-49cb-9b2e-4541b46c0bcc already deleted. [ 650.260215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-185ebe01-c9e3-49cb-9b2e-4541b46c0bcc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.273285] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.529609] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.568281] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17eb131b-ec3d-49bc-9622-abe4401d0c41: rpc.has_security_group_logging(os_id): False [ 650.588034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.588198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.588866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.589667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.589667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.589667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.589667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.589667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.590053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.590053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.590053] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.590162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.590162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.590278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.590366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.591046] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.591046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.591046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.591046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.591046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.591046] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be created. [ 650.679181] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.679181] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.679181] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.683580] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 63f9e194-33fa-4ffd-8c36-a0444c2481f9 not found, creating... [ 650.683580] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.683580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685216] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.685216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.685216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.685216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.685216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685216] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 63f9e194-33fa-4ffd-8c36-a0444c2481f9 is going to be created. [ 650.687460] env[65973]: INFO networking_nsxv3.common.synchronization [req-dec256cd-1354-4f2e-be3f-ff43bbc42a93 req-340b4482-4086-4821-805a-deb8a883c51b tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 650.688567] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.689022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.689129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.689358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.689541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.691827] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 650.692338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.692489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.692741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.692741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.692921] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.693054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.693138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.694768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.694768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.694768] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.712852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 650.718840] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.718840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.718840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.718840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.718840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.719232] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.775409] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.033272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.033456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.033573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.033994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.034319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.034319] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 651.075491] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.075491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.075491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.075491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.075491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.088494] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 651.196024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.201031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.201031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 651.237570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.237570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.237570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.237791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.237837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.251567] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 651.283520] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.284139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.284139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.284421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.284421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.284558] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be updated. [ 651.322029] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.322029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.322029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.322029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.322029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.333025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 651.485598] env[65973]: INFO networking_nsxv3.common.synchronization [req-a63162c5-7ca3-48d7-bbcc-50779503d0b4 req-0897e3a8-3616-472b-af3b-50075978fadc service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 651.485795] env[65973]: INFO networking_nsxv3.common.synchronization [req-a63162c5-7ca3-48d7-bbcc-50779503d0b4 req-0897e3a8-3616-472b-af3b-50075978fadc service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 651.485949] env[65973]: INFO networking_nsxv3.common.synchronization [req-a63162c5-7ca3-48d7-bbcc-50779503d0b4 req-0897e3a8-3616-472b-af3b-50075978fadc service nova] Enqueued Resource ID: 63f9e194-33fa-4ffd-8c36-a0444c2481f9 with Priority: HIGHEST for action port [ 651.486602] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 651.486742] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 651.486834] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63f9e194-33fa-4ffd-8c36-a0444c2481f9 with Priority: HIGHEST for action port [ 651.489234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.489234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.489234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.489234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.489234] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.489234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.489234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.489639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-63f9e194-33fa-4ffd-8c36-a0444c2481f9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.489639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.489639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.489772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.489772] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f9e194-33fa-4ffd-8c36-a0444c2481f9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.926425] env[65973]: INFO networking_nsxv3.common.synchronization [None req-fc4287d4-5c2e-4030-8a1a-dfb7c396a391 None None] Enqueued Resource ID: fe9df56c-6f48-4c24-b80b-60655b54ce41 with Priority: HIGHEST for action port [ 651.927133] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe9df56c-6f48-4c24-b80b-60655b54ce41 with Priority: HIGHEST for action port [ 651.927352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe9df56c-6f48-4c24-b80b-60655b54ce41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.927587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe9df56c-6f48-4c24-b80b-60655b54ce41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.927587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe9df56c-6f48-4c24-b80b-60655b54ce41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.927809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe9df56c-6f48-4c24-b80b-60655b54ce41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.927883] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe9df56c-6f48-4c24-b80b-60655b54ce41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.935177] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c3dcb0d8-0585-49c6-b25d-a06112ab1cb5 None None] Enqueued Resource ID: 09f54565-23ef-4470-94d0-74ace571bdea with Priority: HIGHEST for action port [ 651.935177] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09f54565-23ef-4470-94d0-74ace571bdea with Priority: HIGHEST for action port [ 651.935177] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-09f54565-23ef-4470-94d0-74ace571bdea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.935177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09f54565-23ef-4470-94d0-74ace571bdea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.935177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09f54565-23ef-4470-94d0-74ace571bdea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.935668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09f54565-23ef-4470-94d0-74ace571bdea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.935838] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f54565-23ef-4470-94d0-74ace571bdea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.999426] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63f9e194-33fa-4ffd-8c36-a0444c2481f9 with status ACTIVE [ 651.999426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.999426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.999426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.999426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.999426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.999903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.999903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.999903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.000092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.000175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.000646] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.000646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.000646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.000888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.000888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.000991] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63f9e194-33fa-4ffd-8c36-a0444c2481f9 is going to be updated. [ 652.003378] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.003541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.033734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.034276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.035480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.035480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.035480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.035480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63f9e194-33fa-4ffd-8c36-a0444c2481f9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.438388] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe9df56c-6f48-4c24-b80b-60655b54ce41 [ 652.438670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.438788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.438850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.439096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.439289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.439379] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe9df56c-6f48-4c24-b80b-60655b54ce41 already deleted. [ 652.439452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe9df56c-6f48-4c24-b80b-60655b54ce41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.441899] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09f54565-23ef-4470-94d0-74ace571bdea [ 652.442096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.442224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.442330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.442700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.442841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.443030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09f54565-23ef-4470-94d0-74ace571bdea already deleted. [ 652.443030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09f54565-23ef-4470-94d0-74ace571bdea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.559309] env[65973]: INFO networking_nsxv3.common.synchronization [None req-99818503-b8d4-4cc0-8bc4-c11abee3ea03 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 652.559852] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 652.560261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.560400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.560452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.561028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.561028] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.690122] env[65973]: INFO networking_nsxv3.common.synchronization [None req-fb8bc7fe-af07-46fd-be4a-e39b73d97d09 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 652.691747] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 652.691747] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.691747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.727051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 652.727051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.088228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.088533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.088533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.088831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.088831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.088909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 already deleted. [ 653.088953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.090575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.090880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.091719] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.104381] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 653.104590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.104769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.105000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.105243] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.106343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.106590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.106818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.106915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.107038] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.264616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 653.264885] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 653.265121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.345507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 653.345507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.345507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.345507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.345507] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.345727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.345727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.346481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.346481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.346481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.346481] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.610248] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.615282] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.615462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.615580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.615805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.615962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.616126] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 already deleted. [ 653.616278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.628275] env[65973]: INFO networking_nsxv3.common.synchronization [req-1bfe5481-2399-4e41-b2f3-9e83d83bb730 req-0e2ffe52-34b8-47d2-a087-ffa064e47a6c tempest-SecurityGroupRulesTestJSON-1140248951 tempest-SecurityGroupRulesTestJSON-1140248951-project-member] Enqueued Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 653.629018] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe206044-fd8e-4b78-abf5-253de39bc912 with Priority: HIGHEST for action security_group_rules [ 653.629410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe206044-fd8e-4b78-abf5-253de39bc912 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.629547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.629860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.629860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.629860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe206044-fd8e-4b78-abf5-253de39bc912',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.850355] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.850638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.851169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.851543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.851744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.851876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.851944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.852126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.852255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.852364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.852520] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.852615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.852686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.852820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.852996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.853158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.853218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.853386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.853496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.853590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.853683] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.113245] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.153773] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.154570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.154570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.154570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.154823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.155197] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe206044-fd8e-4b78-abf5-253de39bc912 already deleted. [ 654.155197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe206044-fd8e-4b78-abf5-253de39bc912" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.357459] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b841c0a-397f-4e9d-b02d-5feeaebf26a7: rpc.has_security_group_logging(os_id): False [ 654.375600] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.375600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.375886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.375932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.376269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.376269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.376444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.376444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.376572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.376651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.376845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.376942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.377015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.377173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.377249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.377440] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.377535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.377596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.377737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.377810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.377892] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be updated. [ 654.443748] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.443884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.443959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.444445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.444445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.463124] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 654.470483] env[65973]: INFO networking_nsxv3.common.synchronization [req-4f645faa-3883-494f-b9bd-2151bb8f7bf8 req-959a46d0-e4c7-46a6-a1be-f6b02aaa20eb tempest-DeleteServersAdminTestJSON-1531171471 tempest-DeleteServersAdminTestJSON-1531171471-project-member] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 654.470483] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 654.470483] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.470483] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.470483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.470483] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.616497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.616671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.616774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.617423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.617536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.617679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 654.659866] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.659991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.660074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.660322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.660566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.687352] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 654.885854] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.886063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.887186] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.887186] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.887186] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.887186] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.887186] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.887186] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.887463] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.887463] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.887571] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.887687] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.887833] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.887970] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.888258] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.888522] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.912114] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.912114] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.912114] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.912353] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.912802] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.913467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.913873] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.914156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.914596] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914a1dad-1314-4a0b-92cf-6e93ab61f6f2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.972752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.976372] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.976372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.976372] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be updated. [ 655.022090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.022090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.022090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.022090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.022090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.034086] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 655.416720] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.417178] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.417178] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.417409] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.417563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.417712] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 not found, creating... [ 655.417995] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.418194] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.418314] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.418564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.418691] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.418963] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.419169] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.419289] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.422229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.422372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.422708] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 is going to be created. [ 655.450024] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.450024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.450024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.450024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.450024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.600180] env[65973]: INFO networking_nsxv3.common.synchronization [None req-16da1468-b9c9-4e69-af7c-f97d6a83dde6 None None] Enqueued Resource ID: 9dee03c0-812e-4ecb-96eb-5e153ac5e361 with Priority: HIGHEST for action port [ 655.600180] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dee03c0-812e-4ecb-96eb-5e153ac5e361 with Priority: HIGHEST for action port [ 655.600180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dee03c0-812e-4ecb-96eb-5e153ac5e361 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.600180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dee03c0-812e-4ecb-96eb-5e153ac5e361" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.600180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dee03c0-812e-4ecb-96eb-5e153ac5e361" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.600180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dee03c0-812e-4ecb-96eb-5e153ac5e361" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.600180] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dee03c0-812e-4ecb-96eb-5e153ac5e361',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.102422] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dee03c0-812e-4ecb-96eb-5e153ac5e361 [ 656.102813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.103300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.103623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.103737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.103895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.104056] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dee03c0-812e-4ecb-96eb-5e153ac5e361 already deleted. [ 656.104142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dee03c0-812e-4ecb-96eb-5e153ac5e361" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.153766] env[65973]: INFO networking_nsxv3.common.synchronization [req-6b21c144-520a-4ccd-8d5a-3798da352bee req-3822d42b-6849-4ff7-9f74-11602a4181a8 tempest-ServerAddressesNegativeTestJSON-125459746 tempest-ServerAddressesNegativeTestJSON-125459746-project-member] Enqueued Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 656.154390] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGHEST for action security_group_members [ 656.154667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.154856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.155842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.159734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.159936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.160068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.160131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.160302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.160453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.160570] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.252950] env[65973]: INFO networking_nsxv3.common.synchronization [req-4f645faa-3883-494f-b9bd-2151bb8f7bf8 req-ba7d7ec7-9758-424e-bca8-e13059dd5bfc service nova] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_rules [ 656.253193] env[65973]: INFO networking_nsxv3.common.synchronization [req-4f645faa-3883-494f-b9bd-2151bb8f7bf8 req-ba7d7ec7-9758-424e-bca8-e13059dd5bfc service nova] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 656.253331] env[65973]: INFO networking_nsxv3.common.synchronization [req-4f645faa-3883-494f-b9bd-2151bb8f7bf8 req-ba7d7ec7-9758-424e-bca8-e13059dd5bfc service nova] Enqueued Resource ID: 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 with Priority: HIGHEST for action port [ 656.253841] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_rules [ 656.253994] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 656.254103] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 with Priority: HIGHEST for action port [ 656.254465] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.254593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.254660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.254861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.255059] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.255937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.256053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.256460] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.256460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.256460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.257676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.257676] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914a1dad-1314-4a0b-92cf-6e93ab61f6f2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.478020] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 656.478395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.664270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.664428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.664494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.664726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.664816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.665020] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.665131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.665196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.665352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.665425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.665505] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 is going to be updated. [ 656.700883] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 656.701138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.701433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.701699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.701913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.702055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.702122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.702296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.702381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.702470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.702563] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.706285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.706285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.706285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.706285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.706285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.715398] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: IN_PROGRESS for 2s [ 656.758660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.761333] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 with status ACTIVE [ 656.761333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.761333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.761333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.763362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.763362] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.763362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.763362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.763362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.765012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.765305] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 914a1dad-1314-4a0b-92cf-6e93ab61f6f2 is going to be updated. [ 656.793163] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.793376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.793418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.793644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.793812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.793985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914a1dad-1314-4a0b-92cf-6e93ab61f6f2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.046362] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 657.046893] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 deletion is rescheduled due to dependency. [ 657.047100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.047372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.047701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.047991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.048184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.048279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.048466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.048559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.048677] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.207218] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.208200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.208200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.208200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.208200] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.208200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.208645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.208645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.208645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.208645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.208848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.208930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.212352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.212352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.212352] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.553034] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.716480] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f329967-b7d9-481b-b6ad-3fa408a45e60: rpc.has_security_group_logging(os_id): False [ 657.747383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.747622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.747622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.747972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.747972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.748173] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.748371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.748371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.748542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.748581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.748763] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.748878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.749013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.749068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.749124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.749317] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.749410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.749471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.749612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.749686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.749769] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 657.828875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.829088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.829206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.829675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.829731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.848765] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 657.950408] env[65973]: INFO networking_nsxv3.common.synchronization [None req-4a08d21f-acea-4132-a072-e84d9a0f4e7e None None] Enqueued Resource ID: 1eb6ef11-e6c7-465c-a9af-34363f895d5b with Priority: HIGHEST for action port [ 657.950408] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb6ef11-e6c7-465c-a9af-34363f895d5b with Priority: HIGHEST for action port [ 657.950408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eb6ef11-e6c7-465c-a9af-34363f895d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.952472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eb6ef11-e6c7-465c-a9af-34363f895d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.953053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eb6ef11-e6c7-465c-a9af-34363f895d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.953253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eb6ef11-e6c7-465c-a9af-34363f895d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.953439] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb6ef11-e6c7-465c-a9af-34363f895d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.058230] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.455675] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1eb6ef11-e6c7-465c-a9af-34363f895d5b [ 658.455920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.456159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.456222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.456448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.456758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.456758] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1eb6ef11-e6c7-465c-a9af-34363f895d5b already deleted. [ 658.456758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eb6ef11-e6c7-465c-a9af-34363f895d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.566130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.566130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.566130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.566130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.566592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.566592] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be updated. [ 658.599402] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.599402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.599402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.599402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.599402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.612062] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 658.737056] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 in Status: SUCCESS [ 658.737253] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 deletion is rescheduled due to dependency. [ 658.737372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.853492] env[65973]: INFO networking_nsxv3.common.synchronization [req-5d5ecc02-264f-4b66-9f38-b1d020c4c3d9 req-dc1c8546-552b-41c6-99c3-4d48308e5d1b tempest-InstanceActionsTestJSON-279928980 tempest-InstanceActionsTestJSON-279928980-project-member] Enqueued Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 658.854636] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGHEST for action security_group_members [ 658.854636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.854636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.854636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.854911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.854911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.854911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.855081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.855127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.855207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.855294] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.358256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.358461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.358539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.358765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.358938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.359103] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.359204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.359268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.359427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.359504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.359615] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 is going to be updated. [ 659.390065] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.390385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.390385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.390516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.390662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.402437] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: IN_PROGRESS for 2s [ 659.865855] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 659.865855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.624751] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 660.624907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.625160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.625721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.625721] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.625721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.625721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.625977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.626051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.626118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.626352] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.132270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.132625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.132625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.132703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.132870] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.132970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.133046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.133197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.133312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.133370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.133514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.133607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.133684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.133926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.134014] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.134102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.134161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.134356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.134390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.134442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.134535] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.412693] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 in Status: SUCCESS [ 661.412873] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 deletion is rescheduled due to dependency. [ 661.412986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.643337] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25ed87c4-ad1f-48f1-99b0-f293d53e44d4: rpc.has_security_group_logging(os_id): False [ 661.661393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.661574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.661635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.661980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.661980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.662133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.662209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.662263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.662434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.662521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.662730] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.662842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.662951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.663021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.663100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.663289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.663384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.663442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.663584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.663653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.663739] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be updated. [ 661.735892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.736109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.736184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.736368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.736518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.753805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 662.788756] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e43ef271-ace0-483e-99c8-696c8b61b84b None None] Enqueued Resource ID: 9d205092-3d67-40b3-9d72-957fecca9dbd with Priority: HIGHEST for action port [ 662.788756] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d205092-3d67-40b3-9d72-957fecca9dbd with Priority: HIGHEST for action port [ 662.789613] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d205092-3d67-40b3-9d72-957fecca9dbd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.790411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d205092-3d67-40b3-9d72-957fecca9dbd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.790411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d205092-3d67-40b3-9d72-957fecca9dbd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.790746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d205092-3d67-40b3-9d72-957fecca9dbd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.790912] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d205092-3d67-40b3-9d72-957fecca9dbd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.294269] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d205092-3d67-40b3-9d72-957fecca9dbd [ 663.294269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.294269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.294269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.294627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.294627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.294627] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d205092-3d67-40b3-9d72-957fecca9dbd already deleted. [ 663.296936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d205092-3d67-40b3-9d72-957fecca9dbd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.620028] env[65973]: INFO networking_nsxv3.common.synchronization [None req-90ba47c5-6cf7-4864-88a9-ec978fd656ab None None] Enqueued Resource ID: 5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc with Priority: HIGHEST for action port [ 663.620304] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc with Priority: HIGHEST for action port [ 663.620912] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.621050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.621118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.621381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.621462] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.772058] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 663.772303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.122959] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc [ 664.123284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.123455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.123547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.123833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.124487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.124487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc already deleted. [ 664.124487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ec7dc79-86e0-4846-94f4-8e3b3f64ccfc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.901467] env[65973]: INFO networking_nsxv3.common.synchronization [req-e7cfc9db-6a1b-4862-92ae-f64d6dae59f4 req-765d2bfb-ecf2-46c7-8512-3a9f80d3e4bc tempest-ServersAdminNegativeTestJSON-821105226 tempest-ServersAdminNegativeTestJSON-821105226-project-member] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 664.901993] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 664.902359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.902491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.902564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.902769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.903171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.904151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.904151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.904151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.904151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.904151] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.537580] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.610174] env[65973]: INFO networking_nsxv3.common.synchronization [None req-515c7cb7-6cd6-40e7-84e5-2a714520eb06 None None] Enqueued Resource ID: 7643e2f0-0c6f-4091-9c5e-60bb616973db with Priority: HIGHEST for action port [ 665.610715] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7643e2f0-0c6f-4091-9c5e-60bb616973db with Priority: HIGHEST for action port [ 665.611037] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7643e2f0-0c6f-4091-9c5e-60bb616973db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.611177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7643e2f0-0c6f-4091-9c5e-60bb616973db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.611259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7643e2f0-0c6f-4091-9c5e-60bb616973db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.611484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7643e2f0-0c6f-4091-9c5e-60bb616973db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.611589] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7643e2f0-0c6f-4091-9c5e-60bb616973db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.630802] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.631811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.631811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.631811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.631811] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.632054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.632054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.632683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.632852] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.633075] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.633179] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.633289] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.633384] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.633485] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.633581] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.633702] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.653579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.653773] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.653953] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.654305] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.654448] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.654655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.654714] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.655047] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.655198] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2512ed8-467a-47cf-a76c-9b48ea42c5a2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.767894] env[65973]: INFO networking_nsxv3.common.synchronization [req-9add42e0-706d-499d-a40c-fc8cb60ff139 req-73b1a212-b2fc-46af-8ce7-6e14cd44f214 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 665.768522] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 665.768823] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.769381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.769579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.769891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.770117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.770230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.770298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.770687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.770687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.770787] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.962650] env[65973]: INFO networking_nsxv3.common.synchronization [None req-21b1aa5c-7006-40b1-beb5-83b6a514a4e2 None None] Enqueued Resource ID: 6d6bda5e-efae-4ab0-a03e-4ebd41362d40 with Priority: HIGHEST for action port [ 665.963172] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d6bda5e-efae-4ab0-a03e-4ebd41362d40 with Priority: HIGHEST for action port [ 665.963472] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d6bda5e-efae-4ab0-a03e-4ebd41362d40 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.963593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d6bda5e-efae-4ab0-a03e-4ebd41362d40" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.963659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d6bda5e-efae-4ab0-a03e-4ebd41362d40" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.963922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d6bda5e-efae-4ab0-a03e-4ebd41362d40" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.964010] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d6bda5e-efae-4ab0-a03e-4ebd41362d40',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.040488] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.114257] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7643e2f0-0c6f-4091-9c5e-60bb616973db [ 666.115112] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.115112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.115112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.115356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.115356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.115489] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7643e2f0-0c6f-4091-9c5e-60bb616973db already deleted. [ 666.115489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7643e2f0-0c6f-4091-9c5e-60bb616973db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.157368] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.157613] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.157740] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.158020] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.158233] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.158400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port c2512ed8-467a-47cf-a76c-9b48ea42c5a2 not found, creating... [ 666.158687] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.158842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.159213] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.159577] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.159807] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.160387] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.160614] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.160697] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.160979] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.161187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.161375] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: c2512ed8-467a-47cf-a76c-9b48ea42c5a2 is going to be created. [ 666.184391] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.184556] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.184600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.184833] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.185070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.185288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.273585] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.273808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.273867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.274136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.274271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.274511] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.274616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.274685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.274906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.275022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.275143] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 666.322752] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.322995] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.323143] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.324864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.324864] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.324864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.324864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.324864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.324864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.324864] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.324864] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.324864] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.324864] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.324864] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.325390] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.325390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.326805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.326930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.326976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.327185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.327329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.345425] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 666.357793] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.357963] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.359014] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.359014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.359014] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-f8273666-9542-4d86-9b52-70b3fe327ca4 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.359014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.359014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.359369] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.359446] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8273666-9542-4d86-9b52-70b3fe327ca4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.467076] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d6bda5e-efae-4ab0-a03e-4ebd41362d40 [ 666.467341] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.467456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.467526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.467762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.467879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.467978] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d6bda5e-efae-4ab0-a03e-4ebd41362d40 already deleted. [ 666.468076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d6bda5e-efae-4ab0-a03e-4ebd41362d40" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.544026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.544026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.544026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.544026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.544026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.544026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be updated. [ 666.572549] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.572751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.572795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.573018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.573330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.583537] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 666.861848] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.862283] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.862555] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.862859] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.863056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.863288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port f8273666-9542-4d86-9b52-70b3fe327ca4 not found, creating... [ 666.863687] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.863935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.864138] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.864490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.864689] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.865395] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.865817] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.866173] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.866449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.866634] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.866876] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: f8273666-9542-4d86-9b52-70b3fe327ca4 is going to be created. [ 666.889730] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.889730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.889730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.889730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.889952] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.890136] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.912245] env[65973]: INFO networking_nsxv3.common.synchronization [req-e7cfc9db-6a1b-4862-92ae-f64d6dae59f4 req-9911547d-a1e8-4845-9d3f-3545a9ff504d service nova] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_rules [ 666.912408] env[65973]: INFO networking_nsxv3.common.synchronization [req-e7cfc9db-6a1b-4862-92ae-f64d6dae59f4 req-9911547d-a1e8-4845-9d3f-3545a9ff504d service nova] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 666.912534] env[65973]: INFO networking_nsxv3.common.synchronization [req-e7cfc9db-6a1b-4862-92ae-f64d6dae59f4 req-9911547d-a1e8-4845-9d3f-3545a9ff504d service nova] Enqueued Resource ID: c2512ed8-467a-47cf-a76c-9b48ea42c5a2 with Priority: HIGHEST for action port [ 666.913028] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_rules [ 666.913166] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 666.913263] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2512ed8-467a-47cf-a76c-9b48ea42c5a2 with Priority: HIGHEST for action port [ 666.913526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.913803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.913803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.913987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.914520] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.915477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.916289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.916526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.916663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.916733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.916931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.917073] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2512ed8-467a-47cf-a76c-9b48ea42c5a2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.419336] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.419469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.421023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2512ed8-467a-47cf-a76c-9b48ea42c5a2 with status ACTIVE [ 667.421183] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.422169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.422314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.422616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.422765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.422926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.423089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.423196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.423313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.423516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.423728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.423846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.423905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.424069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.424385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.424385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2512ed8-467a-47cf-a76c-9b48ea42c5a2 is going to be updated. [ 667.448118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.448118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.448118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.448796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.449057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.449361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2512ed8-467a-47cf-a76c-9b48ea42c5a2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.507881] env[65973]: INFO networking_nsxv3.common.synchronization [req-2e8ce0bd-c239-46a9-b96a-775bbd239583 req-65b9eb12-631c-4f87-9e62-2ce76b132e7e tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 667.509835] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 667.511244] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.511244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.511244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.511482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.511712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.511712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.512142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.512142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.512142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.512304] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.636209] env[65973]: INFO networking_nsxv3.common.synchronization [req-9add42e0-706d-499d-a40c-fc8cb60ff139 req-b491b880-8ca2-40a4-ba30-cc2666064be0 service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 667.636549] env[65973]: INFO networking_nsxv3.common.synchronization [req-9add42e0-706d-499d-a40c-fc8cb60ff139 req-b491b880-8ca2-40a4-ba30-cc2666064be0 service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 667.636549] env[65973]: INFO networking_nsxv3.common.synchronization [req-9add42e0-706d-499d-a40c-fc8cb60ff139 req-b491b880-8ca2-40a4-ba30-cc2666064be0 service nova] Enqueued Resource ID: f8273666-9542-4d86-9b52-70b3fe327ca4 with Priority: HIGHEST for action port [ 667.637043] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 667.637412] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 667.637412] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8273666-9542-4d86-9b52-70b3fe327ca4 with Priority: HIGHEST for action port [ 667.637543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.637640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.637701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.637908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.637989] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.639478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.639478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.639478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8273666-9542-4d86-9b52-70b3fe327ca4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.639798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.639798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.641029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.641029] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8273666-9542-4d86-9b52-70b3fe327ca4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.908307] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-32 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.908494] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.908613] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.908923] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.909192] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.909388] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.909480] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.909770] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.909937] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.910141] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.910259] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.910443] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.910443] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.910600] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.910710] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.910804] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.936342] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.936664] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.936869] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.937094] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.937452] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-db5ca003-0bc6-42a6-9c12-59acac320fbc taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.937640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.937788] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.938262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.938467] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db5ca003-0bc6-42a6-9c12-59acac320fbc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.015304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.015488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.015536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.015755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.016011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.016219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.016219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.016340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.016438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.016537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.016595] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 already deleted. [ 668.016673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.141501] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.141819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.141891] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8273666-9542-4d86-9b52-70b3fe327ca4 with status ACTIVE [ 668.142139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.142266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.142266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.142517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.142981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.142981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.142981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.142981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.143233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.143301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.143505] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.143611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.143708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.143872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.144224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.144224] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8273666-9542-4d86-9b52-70b3fe327ca4 is going to be updated. [ 668.166835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.167229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.167229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.167404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.167840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.167840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8273666-9542-4d86-9b52-70b3fe327ca4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.357132] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 668.357420] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 668.357548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.357718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.357925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.358118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.358304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.358419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.358531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.358610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.358739] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.441192] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.441365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.441506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.441777] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.441917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.442074] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port db5ca003-0bc6-42a6-9c12-59acac320fbc not found, creating... [ 668.442335] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.442483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.442593] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.442797] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.442919] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.443249] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.443401] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.443513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.443710] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.443836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.443966] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: db5ca003-0bc6-42a6-9c12-59acac320fbc is going to be created. [ 668.465988] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466254] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466385] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466845] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.471021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.595889] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 668.596161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.596512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.596611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.596777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.596910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.596957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.597378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.597378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.597378] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.863490] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.100783] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.231341] env[65973]: INFO networking_nsxv3.common.synchronization [req-2e8ce0bd-c239-46a9-b96a-775bbd239583 req-624a2853-e454-4b9a-9fea-9ff12f82d5e0 service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 669.231341] env[65973]: INFO networking_nsxv3.common.synchronization [req-2e8ce0bd-c239-46a9-b96a-775bbd239583 req-624a2853-e454-4b9a-9fea-9ff12f82d5e0 service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 669.231341] env[65973]: INFO networking_nsxv3.common.synchronization [req-2e8ce0bd-c239-46a9-b96a-775bbd239583 req-624a2853-e454-4b9a-9fea-9ff12f82d5e0 service nova] Enqueued Resource ID: db5ca003-0bc6-42a6-9c12-59acac320fbc with Priority: HIGHEST for action port [ 669.231889] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 669.231889] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 669.231980] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ca003-0bc6-42a6-9c12-59acac320fbc with Priority: HIGHEST for action port [ 669.232354] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.232446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.232446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.232701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.232849] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.234243] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.234424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.234424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.234594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.234766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.234816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.234870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.235015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.235102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.235193] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.235894] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-db5ca003-0bc6-42a6-9c12-59acac320fbc taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.236024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.236078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.236378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.236378] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db5ca003-0bc6-42a6-9c12-59acac320fbc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.366348] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.602599] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.738383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.738521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.738690] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.740753] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db5ca003-0bc6-42a6-9c12-59acac320fbc with status ACTIVE [ 669.740903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.741031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.741091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.741300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.741666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.741905] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.742017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.742079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.742248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.742327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.742509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.742598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.742651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.742788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.742901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.743140] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db5ca003-0bc6-42a6-9c12-59acac320fbc is going to be updated. [ 669.765294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.765469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.765516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.765753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.765864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.766014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db5ca003-0bc6-42a6-9c12-59acac320fbc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.865158] env[65973]: INFO networking_nsxv3.common.synchronization [None req-40a223b7-ff94-4984-9b83-c6ec1af4f96b None None] Enqueued Resource ID: aa406f0a-a05f-4857-9bd9-612b0d4ae9ce with Priority: HIGHEST for action port [ 669.865158] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa406f0a-a05f-4857-9bd9-612b0d4ae9ce with Priority: HIGHEST for action port [ 669.865760] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa406f0a-a05f-4857-9bd9-612b0d4ae9ce taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.866011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa406f0a-a05f-4857-9bd9-612b0d4ae9ce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.866628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa406f0a-a05f-4857-9bd9-612b0d4ae9ce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.866812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa406f0a-a05f-4857-9bd9-612b0d4ae9ce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.866926] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa406f0a-a05f-4857-9bd9-612b0d4ae9ce',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.870294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.870428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.870495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.870693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.870818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.870887] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 669.905588] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.905781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.905781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.906159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.906159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.916664] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 670.106584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.106743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.106794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.107038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.107275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.107275] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be updated. [ 670.110547] env[65973]: INFO networking_nsxv3.common.synchronization [req-56e1f076-1fc6-46bd-9774-933da21fd253 req-49dbb8a9-0250-49cb-b402-c18ad709a2fe tempest-VolumesAdminNegativeTest-2112045337 tempest-VolumesAdminNegativeTest-2112045337-project-member] Enqueued Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 670.111646] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 670.111750] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.112156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.112156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.112156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.112452] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.112452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.112592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.112677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.112838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.112838] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.142341] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.142487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.142561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.142779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.142922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.152542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 670.241647] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.372882] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa406f0a-a05f-4857-9bd9-612b0d4ae9ce [ 670.372882] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.372882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.372882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.372882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.372882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.372882] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa406f0a-a05f-4857-9bd9-612b0d4ae9ce already deleted. [ 670.372882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa406f0a-a05f-4857-9bd9-612b0d4ae9ce" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.538939] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-839" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-839" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-839" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.540956] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.540956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.541492] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.541492] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.541492] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.541604] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.541648] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.541901] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.541901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.574624] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.574839] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.575036] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.575255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-839" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.575948] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-36f92f06-942a-4aed-ad05-e9c9ec049ec2 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.575948] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.575948] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.576594] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.576594] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f92f06-942a-4aed-ad05-e9c9ec049ec2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.615260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.615411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.615477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.615705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.615792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.616030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.616095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.616148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.616484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.616484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.616484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 192ec921-b8c6-4174-b658-05183df07d9e already deleted. [ 670.616593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.745084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.745294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.745365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.745677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.745823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.746147] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be created. [ 670.888663] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.889123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.889123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.889123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.889342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.901078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: UNINITIALIZED for 2s [ 671.079863] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.080622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.080622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.082745] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.082745] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.082745] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 36f92f06-942a-4aed-ad05-e9c9ec049ec2 not found, creating... [ 671.082745] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.082745] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.082745] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.083124] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.084244] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.085894] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.085894] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.086716] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.086716] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.087604] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.087901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 36f92f06-942a-4aed-ad05-e9c9ec049ec2 is going to be created. [ 671.114098] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.114098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.114098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.114098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.114098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.115782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.857955] env[65973]: INFO networking_nsxv3.common.synchronization [req-56e1f076-1fc6-46bd-9774-933da21fd253 req-cf3bb31b-41db-45b5-bb62-5aa05df28bee service nova] Enqueued Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_rules [ 671.858313] env[65973]: INFO networking_nsxv3.common.synchronization [req-56e1f076-1fc6-46bd-9774-933da21fd253 req-cf3bb31b-41db-45b5-bb62-5aa05df28bee service nova] Enqueued Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 671.858438] env[65973]: INFO networking_nsxv3.common.synchronization [req-56e1f076-1fc6-46bd-9774-933da21fd253 req-cf3bb31b-41db-45b5-bb62-5aa05df28bee service nova] Enqueued Resource ID: 36f92f06-942a-4aed-ad05-e9c9ec049ec2 with Priority: HIGHEST for action port [ 671.864560] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_rules [ 671.864668] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 671.864726] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f92f06-942a-4aed-ad05-e9c9ec049ec2 with Priority: HIGHEST for action port [ 671.866705] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.866873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.866952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.869119] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.869119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.869119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.869119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.869939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.869939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.869939] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.871179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-36f92f06-942a-4aed-ad05-e9c9ec049ec2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.871179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.871179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871633] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f92f06-942a-4aed-ad05-e9c9ec049ec2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.928291] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 671.928652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.928652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.928880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.929084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.929201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.929294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.929468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.929566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.929625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.929714] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.172292] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 672.172517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.172723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.172960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.173199] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.173352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.173527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.173606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.173703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.173791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.173884] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.373813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.374037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.374344] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.377111] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36f92f06-942a-4aed-ad05-e9c9ec049ec2 with status ACTIVE [ 672.377361] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.377493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.377568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.377775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.377859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.378069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.378170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.378299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.378776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.378776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.378776] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.379172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.379172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.379172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.379683] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36f92f06-942a-4aed-ad05-e9c9ec049ec2 is going to be updated. [ 672.403944] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.404486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.404486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.404486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.404619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.406770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36f92f06-942a-4aed-ad05-e9c9ec049ec2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.432431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.432663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.432663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.432862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.433092] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.433194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.433254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.433436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.433704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.433704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.433817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.433918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.434074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.434138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.434270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.434350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.434413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.434562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.434657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.434743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.434831] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.617180] env[65973]: INFO networking_nsxv3.common.synchronization [None req-390c5dd5-b91c-4e0b-8028-731db509df2b tempest-ServersTestFqdnHostnames-1718908810 tempest-ServersTestFqdnHostnames-1718908810-project-member] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 672.617749] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 672.618614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.618614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.618614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.618614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.618614] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.677252] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.677434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.677533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.677800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.677994] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.678163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.678218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.678381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.678477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.678583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.678742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.678859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.678935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.679125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.679249] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.679384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.679467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.679639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.679721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.680750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.680860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.724429] env[65973]: INFO networking_nsxv3.common.synchronization [None req-dd459f9e-89a9-4630-ae36-7d548e379dca tempest-ServersTestFqdnHostnames-1718908810 tempest-ServersTestFqdnHostnames-1718908810-project-member] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 672.725917] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 672.726611] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.726726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.764830] env[65973]: INFO networking_nsxv3.common.synchronization [None req-4c287823-aab7-4374-b062-ce0e439561de None None] Enqueued Resource ID: 3b0d93d9-3342-4359-8eea-3a63da558f96 with Priority: HIGHEST for action port [ 672.765480] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0d93d9-3342-4359-8eea-3a63da558f96 with Priority: HIGHEST for action port [ 672.766583] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b0d93d9-3342-4359-8eea-3a63da558f96 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.766728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b0d93d9-3342-4359-8eea-3a63da558f96" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.766728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b0d93d9-3342-4359-8eea-3a63da558f96" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.767245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b0d93d9-3342-4359-8eea-3a63da558f96" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.767406] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0d93d9-3342-4359-8eea-3a63da558f96',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.878448] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.915980] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.915980] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.915980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.915980] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.936757] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab67debe-f546-499b-8301-c37179fecdee: rpc.has_security_group_logging(os_id): False [ 672.957743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.957930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.958033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.958403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.958528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.958793] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.958938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.959016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.959264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.959386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.959606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.959710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.959822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.959977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.960434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.960759] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.961044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.961161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.961385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.961512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.961662] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 673.037329] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.037988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.038097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.038420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.038590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.068754] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 673.147284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.147452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.147549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.148047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.148047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.148047] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f already deleted. [ 673.148047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.148290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.149015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.149015] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.183157] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3: rpc.has_security_group_logging(os_id): False [ 673.204846] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.206915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.206915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.206915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.207790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.207790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.207790] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.207936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.208063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.209314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.209314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.209314] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be updated. [ 673.270646] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b0d93d9-3342-4359-8eea-3a63da558f96 [ 673.270906] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.271126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.271126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.271613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.271613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.271613] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b0d93d9-3342-4359-8eea-3a63da558f96 already deleted. [ 673.271613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b0d93d9-3342-4359-8eea-3a63da558f96" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.301644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.302047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.302313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.302621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.302859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.333543] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 673.381372] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.381539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.381612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.381842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.381962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.382082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 192ec921-b8c6-4174-b658-05183df07d9e is going to be created. [ 673.422304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.422304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.422304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.422304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.422861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.422861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.422861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.422861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.422999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.422999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.423771] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.432564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.432702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.432774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.433019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.433186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.448163] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: UNINITIALIZED for 2s [ 673.670903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.670903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.670903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.671474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.671474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.671474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f already deleted. [ 673.671601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.928390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1bdd946-26a6-42b9-91bc-053f074c2da1: rpc.has_security_group_logging(os_id): False [ 673.951093] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.951456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.951456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.951595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.951595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.951811] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.951952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.952034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.952214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.952288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.952471] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.952569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.952629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.952770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.952846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.953114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.953248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.953378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.953496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.953567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.953650] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be created. [ 674.018113] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.018384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.018474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.018766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.018959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.034409] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 674.650322] env[65973]: INFO networking_nsxv3.common.synchronization [req-d2cd4add-1547-4636-92db-03bb95a98614 req-02a29241-33c7-4982-93d1-ddb26e40dd3f tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 674.650906] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 674.651216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.651337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.653507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.653757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.654290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.654749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.655270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.658517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.658517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.658517] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.086343] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 675.086343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.160522] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.282234] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-32 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.282490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.282647] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.282943] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.283251] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.283427] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.283572] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.283813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.283962] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.284202] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.284345] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.284451] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.284551] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.284655] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.284901] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.285091] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.309192] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.309487] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.309701] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.309965] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.310469] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-00c4783c-c64f-46c1-93c3-445860ea7359 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.310811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.310974] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.311637] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.311715] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c4783c-c64f-46c1-93c3-445860ea7359',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.351528] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 675.351794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.460918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: SUCCESS [ 675.461375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.461375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.461711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.461825] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.461953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.462051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.462404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.462404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.462404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.462648] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.664027] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.817033] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.818337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.818337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.818337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.818337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.819027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 00c4783c-c64f-46c1-93c3-445860ea7359 not found, creating... [ 675.819348] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.819622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.819622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.820899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.820899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.821309] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.821817] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.822064] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.822387] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.822568] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.822806] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 00c4783c-c64f-46c1-93c3-445860ea7359 is going to be created. [ 675.856075] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.856228] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.856313] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.856654] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.857828] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.857828] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.967676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.967908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.968498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.968498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.968999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.969984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.970118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.970298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.970391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.970490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.970769] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.970877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.970936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.971148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.971360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.971497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.971565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.971753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.971817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.971898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.972036] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.063784] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 676.064056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.171938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.171938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.171938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.171938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.171938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.171938] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 676.211302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.211709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.211709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.211946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.212218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.224726] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 676.475193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 192ec921-b8c6-4174-b658-05183df07d9e: rpc.has_security_group_logging(os_id): False [ 676.499964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.501295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.501415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.501782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.501924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.502079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.502224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.502298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.502493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.502707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.502926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.503142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.503237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.503408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.503530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.503810] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.503954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.503954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.504106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.504211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.504332] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 192ec921-b8c6-4174-b658-05183df07d9e is going to be created. [ 676.584025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.584251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.584302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.584579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.584808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.598354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: IN_PROGRESS for 2s [ 676.674241] env[65973]: INFO networking_nsxv3.common.synchronization [req-d2cd4add-1547-4636-92db-03bb95a98614 req-6fc4bf10-c0bb-43ac-a197-b9105a84832d service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 676.674387] env[65973]: INFO networking_nsxv3.common.synchronization [req-d2cd4add-1547-4636-92db-03bb95a98614 req-6fc4bf10-c0bb-43ac-a197-b9105a84832d service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 676.674735] env[65973]: INFO networking_nsxv3.common.synchronization [req-d2cd4add-1547-4636-92db-03bb95a98614 req-6fc4bf10-c0bb-43ac-a197-b9105a84832d service nova] Enqueued Resource ID: 00c4783c-c64f-46c1-93c3-445860ea7359 with Priority: HIGHEST for action port [ 676.675198] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 676.675496] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 676.675655] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c4783c-c64f-46c1-93c3-445860ea7359 with Priority: HIGHEST for action port [ 676.676746] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.677178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.677275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.677575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.677686] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.679345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.679345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.679345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-00c4783c-c64f-46c1-93c3-445860ea7359 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.680652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.680652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.680652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.680652] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00c4783c-c64f-46c1-93c3-445860ea7359',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.181954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.182413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.182413] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00c4783c-c64f-46c1-93c3-445860ea7359 with status ACTIVE [ 677.182612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.182612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.182766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.182893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.182954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.183168] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.183275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.183315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.183480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.183599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.183767] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.183849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.183925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.185052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.185052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.185052] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00c4783c-c64f-46c1-93c3-445860ea7359 is going to be updated. [ 677.200264] env[65973]: INFO networking_nsxv3.common.synchronization [req-aca74f68-1458-415a-a90b-a68c68874ea1 req-2b9a7a78-fdb5-48c5-ab12-0e8a71fe1c74 tempest-DeleteServersAdminTestJSON-1531171471 tempest-DeleteServersAdminTestJSON-1531171471-project-member] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 677.200725] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGHEST for action security_group_members [ 677.201217] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.201358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.201427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.201644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.201832] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.201992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.201992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.202138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.202222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.202337] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.214294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.214294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.214294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.214294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.214294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.214294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00c4783c-c64f-46c1-93c3-445860ea7359" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.707259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.707259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.707259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.707259] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be updated. [ 677.740216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.740448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.740448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.740715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.741055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.752225] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: IN_PROGRESS for 2s [ 677.895873] env[65973]: INFO networking_nsxv3.common.synchronization [req-531c81dd-c506-4cba-8cdb-f0e3f6594e1f req-70bddd31-72f6-4040-9df7-f37cfc20013d tempest-ServerAddressesTestJSON-1505080710 tempest-ServerAddressesTestJSON-1505080710-project-member] Enqueued Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 677.896518] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 677.896868] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.897023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.898172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.898172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.898172] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.898417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.898417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.898496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.898652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.898822] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.233800] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 678.234144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.234199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.235226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.235226] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.235226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.235226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.236558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.237177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.237177] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.319803] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ad2f151b-cb7f-4ca7-92fe-2aaadec13ca2 None None] Enqueued Resource ID: 08492278-d902-4746-b781-93e76f1d136a with Priority: HIGHEST for action port [ 678.320340] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08492278-d902-4746-b781-93e76f1d136a with Priority: HIGHEST for action port [ 678.320645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-08492278-d902-4746-b781-93e76f1d136a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.320768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08492278-d902-4746-b781-93e76f1d136a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.320836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08492278-d902-4746-b781-93e76f1d136a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.321208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08492278-d902-4746-b781-93e76f1d136a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.321208] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08492278-d902-4746-b781-93e76f1d136a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.398362] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.398561] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-160" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.398677] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-160" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.399544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-160" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.400803] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.400981] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.401108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.401349] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.401490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.401697] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.401807] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.401911] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.402022] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.402128] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.402227] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.402354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.405796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.405923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.405923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.406126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.406222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.406406] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.406511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.406587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.406736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.406815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.406899] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 696853e1-bf6a-45cf-b719-6db77791522b already deleted. [ 678.406978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.427680] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.427840] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.427970] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.428158] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-160" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.428525] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-52bf2607-4a50-46c1-b764-6949a0261f84 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.428695] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.428804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429316] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52bf2607-4a50-46c1-b764-6949a0261f84',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.611141] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: SUCCESS [ 678.611373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.740628] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.823589] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08492278-d902-4746-b781-93e76f1d136a [ 678.823783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.823934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.824028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.824286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.824381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.824509] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08492278-d902-4746-b781-93e76f1d136a already deleted. [ 678.824574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08492278-d902-4746-b781-93e76f1d136a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.933957] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.933957] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 52bf2607-4a50-46c1-b764-6949a0261f84 not found, creating... [ 678.933957] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.933957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.934496] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.934496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.934496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.934496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.934496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.934718] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 52bf2607-4a50-46c1-b764-6949a0261f84 is going to be created. [ 678.956404] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.957020] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.957020] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.957156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.957329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.958399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.244102] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.713426] env[65973]: INFO networking_nsxv3.common.synchronization [req-531c81dd-c506-4cba-8cdb-f0e3f6594e1f req-20244bb6-aacb-4a4a-a709-571739faea06 service nova] Enqueued Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_rules [ 679.713426] env[65973]: INFO networking_nsxv3.common.synchronization [req-531c81dd-c506-4cba-8cdb-f0e3f6594e1f req-20244bb6-aacb-4a4a-a709-571739faea06 service nova] Enqueued Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 679.714377] env[65973]: INFO networking_nsxv3.common.synchronization [req-531c81dd-c506-4cba-8cdb-f0e3f6594e1f req-20244bb6-aacb-4a4a-a709-571739faea06 service nova] Enqueued Resource ID: 52bf2607-4a50-46c1-b764-6949a0261f84 with Priority: HIGHEST for action port [ 679.714638] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_rules [ 679.714775] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 679.714912] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52bf2607-4a50-46c1-b764-6949a0261f84 with Priority: HIGHEST for action port [ 679.716163] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.716358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.716460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.716772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.716909] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.719196] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.719196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.719335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.719573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.721481] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.721634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.721802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.722057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.722176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.722688] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.723981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-52bf2607-4a50-46c1-b764-6949a0261f84 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.724181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.724279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.724488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.724603] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52bf2607-4a50-46c1-b764-6949a0261f84',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.746449] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.747053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.749565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.749565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.749565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.749565] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 679.778926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 in Status: SUCCESS [ 679.778926] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 deletion is rescheduled due to dependency. [ 679.778926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.805688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.805908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.805908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.806145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.806364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.816747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 680.227071] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.227457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.227457] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.228982] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52bf2607-4a50-46c1-b764-6949a0261f84 with status ACTIVE [ 680.229258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.229480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.229480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.229710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.229800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.229991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.230103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.230239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.230369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.230451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.230592] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.230912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.230912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.230912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.231105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.231105] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52bf2607-4a50-46c1-b764-6949a0261f84 is going to be updated. [ 680.259238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.260167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.260382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.260846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.260846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.261034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52bf2607-4a50-46c1-b764-6949a0261f84" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.731498] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.841357] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8bf6014c-e56e-420c-abaa-15aeea410d36 None None] Enqueued Resource ID: e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a with Priority: HIGHEST for action port [ 680.841357] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a with Priority: HIGHEST for action port [ 680.841357] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.841357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.842160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.842420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.842465] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.234167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.234167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.234167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.234420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.234497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.234598] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 696853e1-bf6a-45cf-b719-6db77791522b is going to be created. [ 681.270920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.271356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.271356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.271356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.271506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.285709] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: UNINITIALIZED for 2s [ 681.345303] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a [ 681.345303] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.345303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.345303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.345575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.345724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.346262] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a already deleted. [ 681.346262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a46d8c-032e-4c2b-b5da-3eafa11e4e9a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.495683] env[65973]: INFO networking_nsxv3.common.synchronization [None req-7aadfa5a-acc5-42e1-9cf7-b73e8000f984 None None] Enqueued Resource ID: 38a19753-b146-4a0b-9416-97a1ff0bf10c with Priority: HIGHEST for action port [ 681.496300] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a19753-b146-4a0b-9416-97a1ff0bf10c with Priority: HIGHEST for action port [ 681.496666] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a19753-b146-4a0b-9416-97a1ff0bf10c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.496798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a19753-b146-4a0b-9416-97a1ff0bf10c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.496871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a19753-b146-4a0b-9416-97a1ff0bf10c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.498164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a19753-b146-4a0b-9416-97a1ff0bf10c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.498164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a19753-b146-4a0b-9416-97a1ff0bf10c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.828681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 681.828910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.829108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.829351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.829562] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.829692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.829756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.829919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.830000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.830345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.830452] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.002159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38a19753-b146-4a0b-9416-97a1ff0bf10c [ 682.002701] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.002701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.002701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.003037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.003074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.003205] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38a19753-b146-4a0b-9416-97a1ff0bf10c already deleted. [ 682.003345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a19753-b146-4a0b-9416-97a1ff0bf10c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.335758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.336300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.336300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.336300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.336480] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.336549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.336598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.336733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.336821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.336912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.337069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.337151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.339054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.339054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.339054] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.744861] env[65973]: INFO networking_nsxv3.common.synchronization [req-8d4837f2-798d-484e-a84d-6b4f491e7531 req-c26eac6c-5456-457a-85f0-2608168ca80f tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 682.747544] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 682.747544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.749131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.749257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.749891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.749891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.749891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.749891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.750159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.750159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.750159] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.842825] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1bdd946-26a6-42b9-91bc-053f074c2da1: rpc.has_security_group_logging(os_id): False [ 682.865032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.865173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.865235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.865444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.865526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.865743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.865837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.865893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.866087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.866170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.866300] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.867158] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.867852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.867852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 682.949102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.949880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.949965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.950196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.950351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.966757] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 683.255040] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.295605] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: SUCCESS [ 683.295760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.296078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.296180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.296360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.296584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.296584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.296683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.297342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.297342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.297342] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.420675] env[65973]: INFO networking_nsxv3.common.synchronization [None req-3c9ec6bf-f89c-4587-8703-8fd798a6bd31 tempest-ServersTestManualDisk-443173538 tempest-ServersTestManualDisk-443173538-project-member] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 683.423905] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 683.426578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.427094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.428657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.428657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.428657] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.594767] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-32 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.594767] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.594767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.594767] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.594767] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.594767] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.594767] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.595231] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.595231] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.595231] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.624773] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.624773] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.625309] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.626301] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.626301] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b9538cb8-427b-43ca-ba30-08dcea5d758c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.626672] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.626672] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.626949] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.627173] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9538cb8-427b-43ca-ba30-08dcea5d758c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.756403] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.802206] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.802371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.802432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.802798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.803026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.803155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.803286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.803470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.803582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.803670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.803826] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.803919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.803964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.804150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.804291] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.804405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.804473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.804629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.804695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.804767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.804856] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.806688] env[65973]: INFO networking_nsxv3.common.synchronization [None req-bd12e9dd-c6cd-4576-bc37-4129f2fff9ad tempest-ServersTestManualDisk-443173538 tempest-ServersTestManualDisk-443173538-project-member] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 683.807651] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 683.808190] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.808360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.953424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.953424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.953706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.953827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.953953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.954064] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84af9696-6508-477b-a988-cda90bb86706 already deleted. [ 683.954154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.954399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.954474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.954602] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.132612] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.132612] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.132612] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.132612] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.133187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.133187] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b9538cb8-427b-43ca-ba30-08dcea5d758c not found, creating... [ 684.134329] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.134617] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.134808] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.135516] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.135516] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.135749] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.135940] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.136074] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.136377] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.136573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.136692] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b9538cb8-427b-43ca-ba30-08dcea5d758c is going to be created. [ 684.165439] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.165785] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.166036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.166475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.167188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.167188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.260698] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.260897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.261059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.261358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.261490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.261636] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 684.308859] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 696853e1-bf6a-45cf-b719-6db77791522b: rpc.has_security_group_logging(os_id): False [ 684.312187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.312464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.312610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.312966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.313214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.339065] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 684.351258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.351496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.351496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.351728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.351849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.352079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.352202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.352259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.352431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.352524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.352732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.352843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.352916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.353129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.353259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.353557] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.353707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.353765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.353920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.353995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.354104] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 696853e1-bf6a-45cf-b719-6db77791522b is going to be created. [ 684.422684] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5fc12abe-094b-41db-8553-e035a564e100 None None] Enqueued Resource ID: 7a5d1876-a383-4e45-8bb0-246f932f5e94 with Priority: HIGHEST for action port [ 684.424165] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5d1876-a383-4e45-8bb0-246f932f5e94 with Priority: HIGHEST for action port [ 684.424165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a5d1876-a383-4e45-8bb0-246f932f5e94 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.424396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a5d1876-a383-4e45-8bb0-246f932f5e94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.424396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a5d1876-a383-4e45-8bb0-246f932f5e94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.424785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a5d1876-a383-4e45-8bb0-246f932f5e94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.424951] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a5d1876-a383-4e45-8bb0-246f932f5e94',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.438056] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.438765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.438765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.438765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.438954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.454974] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: IN_PROGRESS for 2s [ 684.481771] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.481771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.481771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.481771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.481771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.482171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84af9696-6508-477b-a988-cda90bb86706 already deleted. [ 684.482171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.928890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a5d1876-a383-4e45-8bb0-246f932f5e94 [ 684.929250] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.929392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.929438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.929725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.929826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.929927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a5d1876-a383-4e45-8bb0-246f932f5e94 already deleted. [ 684.930021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a5d1876-a383-4e45-8bb0-246f932f5e94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.944097] env[65973]: INFO networking_nsxv3.common.synchronization [req-8d4837f2-798d-484e-a84d-6b4f491e7531 req-97d7b743-4b71-43ae-be7f-90629c5cffc5 service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 684.944097] env[65973]: INFO networking_nsxv3.common.synchronization [req-8d4837f2-798d-484e-a84d-6b4f491e7531 req-97d7b743-4b71-43ae-be7f-90629c5cffc5 service nova] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 684.944097] env[65973]: INFO networking_nsxv3.common.synchronization [req-8d4837f2-798d-484e-a84d-6b4f491e7531 req-97d7b743-4b71-43ae-be7f-90629c5cffc5 service nova] Enqueued Resource ID: b9538cb8-427b-43ca-ba30-08dcea5d758c with Priority: HIGHEST for action port [ 684.944297] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_rules [ 684.944403] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 684.944496] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9538cb8-427b-43ca-ba30-08dcea5d758c with Priority: HIGHEST for action port [ 684.944882] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.944956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.945181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.945258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.945433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9538cb8-427b-43ca-ba30-08dcea5d758c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.945528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.945586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.945811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.945893] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9538cb8-427b-43ca-ba30-08dcea5d758c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.984940] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 684.985191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.985467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.985734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.985825] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.455057] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9538cb8-427b-43ca-ba30-08dcea5d758c with status ACTIVE [ 685.455057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.455057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.455057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.455057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.455057] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9538cb8-427b-43ca-ba30-08dcea5d758c is going to be updated. [ 685.485705] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.485705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.485705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.485705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.485705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.485705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9538cb8-427b-43ca-ba30-08dcea5d758c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.488503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.488503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.502129] env[65973]: INFO networking_nsxv3.common.synchronization [req-6b3face9-3f87-42ed-95f7-05889c0f9c7a req-d5b06798-4247-472c-a4ff-d4beb1962be7 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 685.502129] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 685.502129] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.502129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.502129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.502609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.502917] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.503229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.503401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.503863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.504131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.504315] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.971099] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.971304] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.971471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.971752] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.972018] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.972174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.972284] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.972500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.972640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.972872] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.973055] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.973233] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.973395] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.973566] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.973723] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.973906] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.995384] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.995582] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.995716] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.996126] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996391] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-16ffbfbf-9539-4f35-8fee-768cf3603f76 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.996391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.996527] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.996836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.996969] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ffbfbf-9539-4f35-8fee-768cf3603f76',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.007660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.007816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.007871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.008104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.008188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.008470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.009161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.009161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.009161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.009161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.009161] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 already deleted. [ 686.009161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.351508] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 686.351730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.351907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.352134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.352393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.352562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.352666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.353263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.353392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.353553] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.471786] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: SUCCESS [ 686.471786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.499271] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.500194] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.500355] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.500757] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.501034] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.501199] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 16ffbfbf-9539-4f35-8fee-768cf3603f76 not found, creating... [ 686.501509] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.501692] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.501884] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.502449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.502449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.502677] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.502762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.502917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.503255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.503255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.503555] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 16ffbfbf-9539-4f35-8fee-768cf3603f76 is going to be created. [ 686.531054] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.531968] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.531968] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.531968] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.532239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.532481] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.858084] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.917812] env[65973]: INFO networking_nsxv3.common.synchronization [None req-eb80cb45-c35d-4508-bb85-18d12c912790 None None] Enqueued Resource ID: 5125e610-eb17-40f5-92ef-0727a5d538de with Priority: HIGHEST for action port [ 686.918535] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5125e610-eb17-40f5-92ef-0727a5d538de with Priority: HIGHEST for action port [ 686.919026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5125e610-eb17-40f5-92ef-0727a5d538de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.919194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5125e610-eb17-40f5-92ef-0727a5d538de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.919283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5125e610-eb17-40f5-92ef-0727a5d538de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.919663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5125e610-eb17-40f5-92ef-0727a5d538de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.919774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5125e610-eb17-40f5-92ef-0727a5d538de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.307068] env[65973]: INFO networking_nsxv3.common.synchronization [req-6b3face9-3f87-42ed-95f7-05889c0f9c7a req-44627a68-a90f-407b-a249-b0d7d332d99c service nova] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 687.307173] env[65973]: INFO networking_nsxv3.common.synchronization [req-6b3face9-3f87-42ed-95f7-05889c0f9c7a req-44627a68-a90f-407b-a249-b0d7d332d99c service nova] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 687.307234] env[65973]: INFO networking_nsxv3.common.synchronization [req-6b3face9-3f87-42ed-95f7-05889c0f9c7a req-44627a68-a90f-407b-a249-b0d7d332d99c service nova] Enqueued Resource ID: 16ffbfbf-9539-4f35-8fee-768cf3603f76 with Priority: HIGHEST for action port [ 687.307850] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 687.308048] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 687.308105] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ffbfbf-9539-4f35-8fee-768cf3603f76 with Priority: HIGHEST for action port [ 687.308455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.308612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.308661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.308960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.309029] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.313019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.313019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.313019] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.313019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-16ffbfbf-9539-4f35-8fee-768cf3603f76 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.313019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.313019] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ffbfbf-9539-4f35-8fee-768cf3603f76',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.360571] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.423624] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5125e610-eb17-40f5-92ef-0727a5d538de [ 687.424891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.424891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.424891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.425066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.425163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.425264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5125e610-eb17-40f5-92ef-0727a5d538de already deleted. [ 687.425342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5125e610-eb17-40f5-92ef-0727a5d538de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.817030] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.817030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.817030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16ffbfbf-9539-4f35-8fee-768cf3603f76 with status ACTIVE [ 687.817030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.817030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.817030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.818241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.818241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.818241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.823037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.823037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.823037] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16ffbfbf-9539-4f35-8fee-768cf3603f76 is going to be updated. [ 687.848290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.848766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.848766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.849072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.849072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.849234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16ffbfbf-9539-4f35-8fee-768cf3603f76" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.863148] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.863558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.863780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.863932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.864107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.864151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 687.900605] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.900714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.900756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.900959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.901119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.917456] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 688.326703] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.832984] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.835378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.835378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.835378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.835378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.835378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be created. [ 688.835881] env[65973]: INFO networking_nsxv3.common.synchronization [None req-996197f5-d5a6-43db-9c35-47e2e9645aa9 None None] Enqueued Resource ID: b25b57dc-731b-4432-8bec-28b9db490931 with Priority: HIGHEST for action port [ 688.836269] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25b57dc-731b-4432-8bec-28b9db490931 with Priority: HIGHEST for action port [ 688.836983] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25b57dc-731b-4432-8bec-28b9db490931 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.837131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25b57dc-731b-4432-8bec-28b9db490931" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.837596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25b57dc-731b-4432-8bec-28b9db490931" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.837596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25b57dc-731b-4432-8bec-28b9db490931" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.837596] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25b57dc-731b-4432-8bec-28b9db490931',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.865034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.865034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.865034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.865034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.865034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.877861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: UNINITIALIZED for 2s [ 689.279593] env[65973]: INFO networking_nsxv3.common.synchronization [None req-d3ce1c91-2287-4f03-9811-41ae527c3b6a None None] Enqueued Resource ID: ebaeddcb-2f0a-4f11-9118-489d7b727674 with Priority: HIGHEST for action port [ 689.280185] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebaeddcb-2f0a-4f11-9118-489d7b727674 with Priority: HIGHEST for action port [ 689.283024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebaeddcb-2f0a-4f11-9118-489d7b727674 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.283024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebaeddcb-2f0a-4f11-9118-489d7b727674" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.283024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebaeddcb-2f0a-4f11-9118-489d7b727674" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.283024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebaeddcb-2f0a-4f11-9118-489d7b727674" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.283024] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebaeddcb-2f0a-4f11-9118-489d7b727674',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.340437] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b25b57dc-731b-4432-8bec-28b9db490931 [ 689.340672] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.340805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.340875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.341529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.341529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.341529] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b25b57dc-731b-4432-8bec-28b9db490931 already deleted. [ 689.341529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25b57dc-731b-4432-8bec-28b9db490931" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.784436] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebaeddcb-2f0a-4f11-9118-489d7b727674 [ 689.784699] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.784845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.784912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.785165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.785278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.785373] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebaeddcb-2f0a-4f11-9118-489d7b727674 already deleted. [ 689.785471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebaeddcb-2f0a-4f11-9118-489d7b727674" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.829483] env[65973]: INFO networking_nsxv3.common.synchronization [req-e3e064d7-920b-4bd2-b9e7-1da956fba453 req-40240249-cd53-44ba-a92c-24cd221d97b8 tempest-ServersTestJSON-1831836165 tempest-ServersTestJSON-1831836165-project-member] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 689.832049] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGHEST for action security_group_members [ 689.832049] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.832049] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.832049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.832049] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.930035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 689.930035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.930035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.930397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.930397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.930397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.930546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.930868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.930868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.930868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.930868] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.334452] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.334611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.334714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.334950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.335417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.335477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.335621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.335671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.335832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.335921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.336043] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 is going to be updated. [ 690.371872] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.372020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.372789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.373134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.373298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.384851] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: IN_PROGRESS for 2s [ 690.434622] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.434764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.435320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.435320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.435320] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.435471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.435543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.435899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.435899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.436019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.436115] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.436249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.436286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.436416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.436556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.436643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.436701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.436876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.436916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.436993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.437169] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.881517] env[65973]: INFO networking_nsxv3.common.synchronization [req-15cc47c6-bfa0-4942-95dc-8400a89fb961 req-7b9aab4c-b29c-46df-b7ec-b347758a6f78 tempest-FloatingIPsAssociationNegativeTestJSON-122133943 tempest-FloatingIPsAssociationNegativeTestJSON-122133943-project-member] Enqueued Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 690.882727] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 690.883091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.883227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.883276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.883549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.883779] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.883888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.883888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.884023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.884105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.884201] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.892402] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 690.892616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.893559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.893635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.893793] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.893964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.894741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.895204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.895204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.895204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.895204] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.941577] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1bdd946-26a6-42b9-91bc-053f074c2da1: rpc.has_security_group_logging(os_id): False [ 690.967024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967550] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.967550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.967550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 691.037533] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.037793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.037892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.038133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.038290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.059972] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 691.306160] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5858899f-192a-4092-b4ec-2d2aba270f0f None None] Enqueued Resource ID: 53c1f9e7-33c3-458d-aafc-b8f106cb9124 with Priority: HIGHEST for action port [ 691.306443] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53c1f9e7-33c3-458d-aafc-b8f106cb9124 with Priority: HIGHEST for action port [ 691.307034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-53c1f9e7-33c3-458d-aafc-b8f106cb9124 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.307160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53c1f9e7-33c3-458d-aafc-b8f106cb9124" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.307217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53c1f9e7-33c3-458d-aafc-b8f106cb9124" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.307470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53c1f9e7-33c3-458d-aafc-b8f106cb9124" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.307554] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c1f9e7-33c3-458d-aafc-b8f106cb9124',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.386528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.386716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.386841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.387102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.387652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.387652] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.387652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.387652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.387652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.387888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.387888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b19a464-262b-473d-9f50-535013bda763 already deleted. [ 691.387888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.397440] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.574104] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.574254] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-576" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.574371] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-576" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.574695] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-576" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.575475] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.575475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.575475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.575803] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.575941] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.576605] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.576605] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.576605] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.576605] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.576605] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.576774] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.576801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.598028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.598182] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.598767] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.598767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-576" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.598767] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-2c2248c5-0aa9-4171-ab05-613b013f61ab taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.599352] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.599352] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.599427] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.599526] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2248c5-0aa9-4171-ab05-613b013f61ab',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.810732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53c1f9e7-33c3-458d-aafc-b8f106cb9124 [ 691.810732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.810732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.810732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.810732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.810732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.810732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53c1f9e7-33c3-458d-aafc-b8f106cb9124 already deleted. [ 691.810732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53c1f9e7-33c3-458d-aafc-b8f106cb9124" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.900071] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8da0d868-de85-4818-aa51-4d52389cba32: rpc.has_security_group_logging(os_id): False [ 691.922619] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.922800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.922800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.923733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.923733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.923733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.923733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.923733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.923733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.924035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.924035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be created. [ 691.988791] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.988791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.988791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.988791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.989245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.002584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 692.087417] env[65973]: INFO networking_nsxv3.common.synchronization [None req-1332563b-acf5-47da-9c77-2216886e4145 None None] Enqueued Resource ID: fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c with Priority: HIGHEST for action port [ 692.087549] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c with Priority: HIGHEST for action port [ 692.088012] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.088012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.088262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.088547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.088688] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.103374] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.103620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.103764] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.104497] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.104497] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.104497] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 2c2248c5-0aa9-4171-ab05-613b013f61ab not found, creating... [ 692.104799] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.104926] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.106592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.106592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.106592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.106592] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.106592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.106592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.106877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.106877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.107044] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 2c2248c5-0aa9-4171-ab05-613b013f61ab is going to be created. [ 692.131773] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.132326] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.132326] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.132436] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.132618] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.132855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.396971] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 in Status: SUCCESS [ 692.396971] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 deletion is rescheduled due to dependency. [ 692.396971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.594681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c [ 692.596564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.596564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.596564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.596564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.596564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.596564] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c already deleted. [ 692.596877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa2c31a0-6ae7-45eb-bbae-bbe954d3f75c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.856301] env[65973]: INFO networking_nsxv3.common.synchronization [req-15cc47c6-bfa0-4942-95dc-8400a89fb961 req-af8bc2aa-7e5e-48a7-9a4d-96c3539ab28f service nova] Enqueued Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_rules [ 692.856439] env[65973]: INFO networking_nsxv3.common.synchronization [req-15cc47c6-bfa0-4942-95dc-8400a89fb961 req-af8bc2aa-7e5e-48a7-9a4d-96c3539ab28f service nova] Enqueued Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 692.856569] env[65973]: INFO networking_nsxv3.common.synchronization [req-15cc47c6-bfa0-4942-95dc-8400a89fb961 req-af8bc2aa-7e5e-48a7-9a4d-96c3539ab28f service nova] Enqueued Resource ID: 2c2248c5-0aa9-4171-ab05-613b013f61ab with Priority: HIGHEST for action port [ 692.859150] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_rules [ 692.859478] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 692.859721] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2248c5-0aa9-4171-ab05-613b013f61ab with Priority: HIGHEST for action port [ 692.860064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.860199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.860267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.860538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.860646] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.861893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.862026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.862123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.864039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.864039] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.864039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c2248c5-0aa9-4171-ab05-613b013f61ab taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.864039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.864454] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2248c5-0aa9-4171-ab05-613b013f61ab',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.081351] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 693.082077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.347226] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6eda369-5bc0-4e9a-9237-29bf0f2f2492 req-08454f36-f490-4190-afe3-5091244d89c0 tempest-FloatingIPsAssociationTestJSON-1939154346 tempest-FloatingIPsAssociationTestJSON-1939154346-project-member] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 693.348385] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 693.348796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.348923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.349011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.349246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.349406] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.349506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.349566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.349718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.349801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.349893] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.367118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.367118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.367118] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.370549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c2248c5-0aa9-4171-ab05-613b013f61ab with status ACTIVE [ 693.370857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.371130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.371262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.371412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.371506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.371704] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.371805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.371877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.373536] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.373536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.373536] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c2248c5-0aa9-4171-ab05-613b013f61ab is going to be updated. [ 693.401302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.401519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.401568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.402642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.402642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.402642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c2248c5-0aa9-4171-ab05-613b013f61ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.730518] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.730518] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.731723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.731723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.731723] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.732300] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.732300] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.732300] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.732451] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.732543] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.732655] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.732775] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.732918] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.733043] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.733155] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.733284] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.755367] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.755533] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.755680] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.756158] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-859" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.756289] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-17505e6b-4e54-4bc8-80e6-20dbbb505673 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.756489] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.756608] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.756967] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.757135] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17505e6b-4e54-4bc8-80e6-20dbbb505673',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.852686] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.870773] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.015357] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 694.015583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.259359] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.259771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.260017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.260584] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.260651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.260921] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 17505e6b-4e54-4bc8-80e6-20dbbb505673 not found, creating... [ 694.261775] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.261775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.261775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.261775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.261775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.262102] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.262102] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.262229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.262386] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.262509] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.262639] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 17505e6b-4e54-4bc8-80e6-20dbbb505673 is going to be created. [ 694.284126] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.284335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.284450] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.284724] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.284952] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.285181] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.355753] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.374537] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.374721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.374753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.375366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.375366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.375366] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b19a464-262b-473d-9f50-535013bda763 is going to be created. [ 694.404141] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.405239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.405239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.405239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.405239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.416293] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: UNINITIALIZED for 2s [ 694.485508] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ad2839ba-0812-4a24-af0e-24f668e8040f None None] Enqueued Resource ID: fda6d96a-ee65-4612-a13e-59dbefe92615 with Priority: HIGHEST for action port [ 694.485814] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda6d96a-ee65-4612-a13e-59dbefe92615 with Priority: HIGHEST for action port [ 694.487242] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-fda6d96a-ee65-4612-a13e-59dbefe92615 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.488057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fda6d96a-ee65-4612-a13e-59dbefe92615" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.488057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fda6d96a-ee65-4612-a13e-59dbefe92615" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.488057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fda6d96a-ee65-4612-a13e-59dbefe92615" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.488057] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fda6d96a-ee65-4612-a13e-59dbefe92615',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.860260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.860738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.860738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.860890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.860985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.861139] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be updated. [ 694.905912] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.906074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.906074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.906294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.906512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.917135] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 694.932593] env[65973]: INFO networking_nsxv3.common.synchronization [req-c4c8ec8f-85ad-4e67-ab42-7e20850205d0 req-79be0312-e878-4de7-980c-1f6a98741815 tempest-VolumesAssistedSnapshotsTest-1512252783 tempest-VolumesAssistedSnapshotsTest-1512252783-project-member] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 694.933599] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGHEST for action security_group_members [ 694.933937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.934367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.934367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.934460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.934663] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.934965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.934965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.935070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.935179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.935288] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.993544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fda6d96a-ee65-4612-a13e-59dbefe92615 [ 694.993876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.994023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.994092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.994308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.994431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.994546] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fda6d96a-ee65-4612-a13e-59dbefe92615 already deleted. [ 694.994629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fda6d96a-ee65-4612-a13e-59dbefe92615" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.087860] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6eda369-5bc0-4e9a-9237-29bf0f2f2492 req-95029f34-6a5e-4fdf-bb9e-a9da8a28d96b service nova] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_rules [ 695.087860] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6eda369-5bc0-4e9a-9237-29bf0f2f2492 req-95029f34-6a5e-4fdf-bb9e-a9da8a28d96b service nova] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 695.088042] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6eda369-5bc0-4e9a-9237-29bf0f2f2492 req-95029f34-6a5e-4fdf-bb9e-a9da8a28d96b service nova] Enqueued Resource ID: 17505e6b-4e54-4bc8-80e6-20dbbb505673 with Priority: HIGHEST for action port [ 695.088181] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_rules [ 695.088317] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 695.088412] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17505e6b-4e54-4bc8-80e6-20dbbb505673 with Priority: HIGHEST for action port [ 695.090627] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.091369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.091453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.091761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.091868] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.094389] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.094389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.094389] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-17505e6b-4e54-4bc8-80e6-20dbbb505673 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.094389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.094389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.094698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.094698] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17505e6b-4e54-4bc8-80e6-20dbbb505673',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.437687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.437967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.437967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.438155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.438275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.438553] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.438663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.438726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.438891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.438970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.439070] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa is going to be updated. [ 695.470635] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.470790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.470869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.471414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.471566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.482564] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: IN_PROGRESS for 2s [ 695.596259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.596407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.596682] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17505e6b-4e54-4bc8-80e6-20dbbb505673 with status ACTIVE [ 695.596814] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.597016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.597097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.597333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.597428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.597597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.597696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.597758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.597912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.598326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.598603] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.598694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.598758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.598913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.598990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.599089] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17505e6b-4e54-4bc8-80e6-20dbbb505673 is going to be updated. [ 695.645853] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.645967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.645967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.646214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.646582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.646582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17505e6b-4e54-4bc8-80e6-20dbbb505673" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.863141] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f1618534-b50d-4c90-b6b7-9b88e73dd1b9 tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 695.863695] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 695.864015] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.865482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.865634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.865928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.866025] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.985032] env[65973]: INFO networking_nsxv3.common.synchronization [None req-7fd702bd-c121-44fa-8849-5a9f74e22c15 tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 695.985032] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 695.985032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.985032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.390314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.390481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.390548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.390749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.390850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.390945] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec already deleted. [ 696.391034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.391194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.391355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.391440] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.429037] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: SUCCESS [ 696.429037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.429037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.429037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.429465] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.429465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.429465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.429465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.429858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.429858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.429858] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.791592] env[65973]: INFO networking_nsxv3.common.synchronization [req-52b2a63a-15de-4adc-9e85-dfbd7940e9d1 req-d66d5a26-3e22-4113-8505-aa409dbfda8f tempest-VolumesAdminNegativeTest-2112045337 tempest-VolumesAdminNegativeTest-2112045337-project-member] Enqueued Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 696.792491] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGHEST for action security_group_members [ 696.792862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.792987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.793069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.793281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.793489] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.793598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.793662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.793824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.793913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.794016] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.915518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.915716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.915807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.916015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.916118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.916222] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec already deleted. [ 696.916304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.927805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 696.928065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.928244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.928605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.928808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.929009] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.929184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.929472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.929731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.929914] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.932491] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.932637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.932637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.935345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.935345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.935714] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.935714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.935829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.936094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.936319] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.936485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.936609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.936827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.936991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.937162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.937321] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.302391] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.302602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.302602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.302833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.302929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.303200] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.303337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.303407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.303606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.303685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.303812] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 192ec921-b8c6-4174-b658-05183df07d9e is going to be updated. [ 697.346736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.347314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.347314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.347473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.347999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.357972] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: IN_PROGRESS for 2s [ 697.439979] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.440939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b19a464-262b-473d-9f50-535013bda763: rpc.has_security_group_logging(os_id): False [ 697.474327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.474566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.474764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.474857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.474979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.475266] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.475392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.475555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.475632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.475759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.476130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.476379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.476379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.476552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.476655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.476854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.476994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.477402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.477402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.477402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.477775] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b19a464-262b-473d-9f50-535013bda763 is going to be created. [ 697.495390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43cc61c-6eaf-4868-a452-7def78ad6faa in Status: SUCCESS [ 697.495543] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa deletion is rescheduled due to dependency. [ 697.495671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.548121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.548275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.548275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.548555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.548746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.561740] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: IN_PROGRESS for 2s [ 697.943887] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.447152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.447312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.447386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.447598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.447695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.447795] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be updated. [ 698.481219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.481371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.481409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.481830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.481913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.491616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 699.371557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 192ec921-b8c6-4174-b658-05183df07d9e in Status: SUCCESS [ 699.371557] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 192ec921-b8c6-4174-b658-05183df07d9e deletion is rescheduled due to dependency. [ 699.371943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.576291] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: SUCCESS [ 699.576569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.512047] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 700.512874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.513243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.513783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.513958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.514231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.514300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.514642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.514767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.514957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.515141] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.020332] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.020332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.020332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.020332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.020332] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.020332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.020332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.020578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.020578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.020578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.020830] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.020916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.021042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.021153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.021312] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.021412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.021463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.021609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.021674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.022008] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.022008] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.529558] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17eb131b-ec3d-49bc-9622-abe4401d0c41: rpc.has_security_group_logging(os_id): False [ 701.558022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.558022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.558022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.558022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.558674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.558674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.558674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.558674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.558674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.558674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be updated. [ 701.637417] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.637770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.637770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.637939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.638137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.660048] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 701.793815] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 701.793900] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 701.866616] env[65973]: INFO networking_nsxv3.common.synchronization [req-92be1a24-865c-4d55-97ae-735b1e903bb7 req-b76a4ed9-ecc1-4330-909d-f4f4d6b7b9ef tempest-ImagesNegativeTestJSON-745035862 tempest-ImagesNegativeTestJSON-745035862-project-member] Enqueued Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 701.866616] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 701.866616] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.866616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.866616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.866806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.867350] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.867539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.867751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.867988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.868110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.868322] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.043645] env[65973]: INFO networking_nsxv3.common.synchronization [req-6f56df29-e317-42f5-a86a-dcd84bdb2063 req-af35b977-5dd6-4870-947c-f9ed8527e473 tempest-ServerAddressesTestJSON-1505080710 tempest-ServerAddressesTestJSON-1505080710-project-member] Enqueued Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 702.046031] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGHEST for action security_group_members [ 702.046482] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.046690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.046782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.047057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.047248] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.047651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.047736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.048339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.048339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.048339] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.371060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.371242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.372068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.372068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.372068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.372481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.372481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.372630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.372847] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b already deleted. [ 702.373485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.497855] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.498256] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-245" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.498256] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-245" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.499073] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-245" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.499154] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.499325] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.499441] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.499679] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.499844] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.500110] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.500325] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.500325] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.500421] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.500575] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.500730] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.500958] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.526601] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.526976] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.526976] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.527210] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-245" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.527485] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-d94c660e-60c6-4df8-aef9-a10838f1ddda taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.527739] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.527877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.528209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.528371] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94c660e-60c6-4df8-aef9-a10838f1ddda',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.550290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.550630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.550630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.550698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.550785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.550989] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.551100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.551165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.551326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.551551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.551551] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 696853e1-bf6a-45cf-b719-6db77791522b is going to be updated. [ 702.590181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.590181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.590181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.590181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.590181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.601586] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: IN_PROGRESS for 2s [ 703.031298] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.031500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.031642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.031931] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.032106] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.032275] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port d94c660e-60c6-4df8-aef9-a10838f1ddda not found, creating... [ 703.032539] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.032693] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.032822] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.033077] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.033217] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.033516] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.033683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.033792] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.034010] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.034157] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.034307] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: d94c660e-60c6-4df8-aef9-a10838f1ddda is going to be created. [ 703.063026] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.063281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.063394] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.063739] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.063986] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.064238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.676326] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 703.676638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.774234] env[65973]: INFO networking_nsxv3.common.synchronization [req-92be1a24-865c-4d55-97ae-735b1e903bb7 req-ca453291-9097-4f38-9bc1-82ccd0721ba6 service nova] Enqueued Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_rules [ 703.774234] env[65973]: INFO networking_nsxv3.common.synchronization [req-92be1a24-865c-4d55-97ae-735b1e903bb7 req-ca453291-9097-4f38-9bc1-82ccd0721ba6 service nova] Enqueued Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 703.774234] env[65973]: INFO networking_nsxv3.common.synchronization [req-92be1a24-865c-4d55-97ae-735b1e903bb7 req-ca453291-9097-4f38-9bc1-82ccd0721ba6 service nova] Enqueued Resource ID: d94c660e-60c6-4df8-aef9-a10838f1ddda with Priority: HIGHEST for action port [ 703.774648] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_rules [ 703.774841] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 703.775267] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c660e-60c6-4df8-aef9-a10838f1ddda with Priority: HIGHEST for action port [ 703.775324] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.775455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.775545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.776088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.776196] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.777629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.777802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.777802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.777996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.778233] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.778335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.778403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.778859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.778969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.780044] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.781458] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d94c660e-60c6-4df8-aef9-a10838f1ddda taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.781569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.781821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.781821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.781917] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94c660e-60c6-4df8-aef9-a10838f1ddda',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.958678] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e910c393-6df7-41cb-8190-448f22473814 None None] Enqueued Resource ID: 6f0215f3-f358-4734-b736-346c5d594e50 with Priority: HIGHEST for action port [ 703.959853] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0215f3-f358-4734-b736-346c5d594e50 with Priority: HIGHEST for action port [ 703.959853] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f0215f3-f358-4734-b736-346c5d594e50 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.959853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f0215f3-f358-4734-b736-346c5d594e50" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.959853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f0215f3-f358-4734-b736-346c5d594e50" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.960152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f0215f3-f358-4734-b736-346c5d594e50" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.960394] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f0215f3-f358-4734-b736-346c5d594e50',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.282336] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.285258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.285477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.286865] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d94c660e-60c6-4df8-aef9-a10838f1ddda with status ACTIVE [ 704.287083] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.287207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.287275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.287495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.287590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.287772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.287872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.287935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.288103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.288183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.288366] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.288458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.288583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.288739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.288815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.288899] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d94c660e-60c6-4df8-aef9-a10838f1ddda is going to be updated. [ 704.313913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.314146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.314272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.314629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.314921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.315219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d94c660e-60c6-4df8-aef9-a10838f1ddda" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.463063] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f0215f3-f358-4734-b736-346c5d594e50 [ 704.463063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.463063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.463063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.463063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.463063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.463063] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f0215f3-f358-4734-b736-346c5d594e50 already deleted. [ 704.463063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f0215f3-f358-4734-b736-346c5d594e50" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.550555] env[65973]: INFO networking_nsxv3.common.synchronization [req-437eb38d-4ad7-4ee5-b4ac-82eb270423d7 req-b9c1e361-8d97-44d4-ae6c-78de37716d28 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 704.551374] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 704.552219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.552824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.552824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.552824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.552824] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.554021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.554021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.554021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.554021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.554021] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.614089] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 696853e1-bf6a-45cf-b719-6db77791522b in Status: SUCCESS [ 704.614273] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 696853e1-bf6a-45cf-b719-6db77791522b deletion is rescheduled due to dependency. [ 704.614488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.784575] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.972054] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.972054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.972418] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.972418] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.976024] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.976024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.976024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.979772] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.979772] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.979772] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.979772] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.980312] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.980312] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.980312] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.980312] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.980481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.003151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.003387] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.003528] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.003699] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-913" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.004062] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.004269] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.004462] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.004865] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.005103] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.056327] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.293026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.293170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.293227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.293446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.293541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.293640] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b is going to be created. [ 705.324505] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.324505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.324505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.324505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.335015] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: UNINITIALIZED for 2s [ 705.514022] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.514022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f not found, creating... [ 705.514022] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.514022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.514475] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.514475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.514475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.514857] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.515163] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.515396] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f is going to be created. [ 705.541027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.541027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.541027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.541347] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.541484] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.541731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.562032] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.063186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.063533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.063533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.063721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.063846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.063952] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 706.103167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.103382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.103453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.103663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.103947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.118848] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 706.329450] env[65973]: INFO networking_nsxv3.common.synchronization [req-437eb38d-4ad7-4ee5-b4ac-82eb270423d7 req-6ffae502-c5bb-467d-a21f-082b7bdcc834 service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 706.329506] env[65973]: INFO networking_nsxv3.common.synchronization [req-437eb38d-4ad7-4ee5-b4ac-82eb270423d7 req-6ffae502-c5bb-467d-a21f-082b7bdcc834 service nova] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 706.329658] env[65973]: INFO networking_nsxv3.common.synchronization [req-437eb38d-4ad7-4ee5-b4ac-82eb270423d7 req-6ffae502-c5bb-467d-a21f-082b7bdcc834 service nova] Enqueued Resource ID: caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f with Priority: HIGHEST for action port [ 706.330274] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_rules [ 706.330454] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 706.330523] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f with Priority: HIGHEST for action port [ 706.330800] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.330968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.331071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.331345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.331454] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.332478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.332592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.332848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.332957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.333142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.333413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.333413] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.561171] env[65973]: INFO networking_nsxv3.common.synchronization [None req-bc12ce68-2c68-497b-97fe-f99e3eb956a5 None None] Enqueued Resource ID: d7923412-f149-4545-a41e-084b135f4cc8 with Priority: HIGHEST for action port [ 706.561819] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7923412-f149-4545-a41e-084b135f4cc8 with Priority: HIGHEST for action port [ 706.562449] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7923412-f149-4545-a41e-084b135f4cc8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.564017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7923412-f149-4545-a41e-084b135f4cc8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.564117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7923412-f149-4545-a41e-084b135f4cc8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.564918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7923412-f149-4545-a41e-084b135f4cc8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.565035] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7923412-f149-4545-a41e-084b135f4cc8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.836237] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.836514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.838243] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f with status ACTIVE [ 706.838499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.838676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.838751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.839082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.839186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.840165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.840165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.840165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.840726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.840726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.840726] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f is going to be updated. [ 706.869535] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.869702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.869766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.870011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.870218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.870394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-caebb1f6-1ed1-4bcb-a0ca-8c027e05e01f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.067578] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7923412-f149-4545-a41e-084b135f4cc8 [ 707.068516] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.068674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.068748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.069028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.069173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.069281] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7923412-f149-4545-a41e-084b135f4cc8 already deleted. [ 707.069418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7923412-f149-4545-a41e-084b135f4cc8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.349379] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: SUCCESS [ 707.349873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.349873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.350227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.350477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.350673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.350775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.351023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.351227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.351357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.351482] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.447031] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ce49b4e-0f0a-4814-be41-7eb7cb8f75b5 req-059be4af-3a48-4c25-bb94-02a0dfdc7923 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 707.447031] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 707.447031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.447031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.447031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.447920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.448358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.448814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.449618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.450147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.450147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.450394] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.846197] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-415 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.846197] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.846197] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.846197] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.847251] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.848878] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.848878] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.849728] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.849894] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850133] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.850829] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.850829] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.850829] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.850829] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.850829] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.850829] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.856463] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.856463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.856463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.856716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.856964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.856964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.856964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.857671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.857671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.857984] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.857984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.857984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.858116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.858164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.858238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.858331] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.881999] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.881999] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.882189] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.882435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.882643] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.882786] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.882911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.883371] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.883550] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f9ee58-2fed-4e58-a6bf-08bed37e3a39',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.953909] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.954110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.954189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.954402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.954541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.954733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.954827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.954891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.955057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.955140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.955223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 already deleted. [ 707.955301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.134109] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 708.134530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.134530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.135020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.135345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.135511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.135661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.135838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.135958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.136117] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.363721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0397097b-0163-421f-b162-1b4a632f3e6b: rpc.has_security_group_logging(os_id): False [ 708.386117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.386325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.386369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.386630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.386736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.386938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.387049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.387109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.387352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.387534] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.387629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.387752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.387940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.388102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.388224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.388343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.388609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.388716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.388828] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b is going to be created. [ 708.390306] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.390483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.390660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.390838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.391018] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.391163] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 not found, creating... [ 708.391420] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.391826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.391903] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.392125] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.392260] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.392530] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.392698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.392843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.393027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.393156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.393283] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 is going to be created. [ 708.416017] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.416255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.416382] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.416667] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.416908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.417149] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.462039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.462039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.462296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.462333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.462510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.490811] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: IN_PROGRESS for 2s [ 708.639047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.134665] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ce49b4e-0f0a-4814-be41-7eb7cb8f75b5 req-c24309d7-aeed-413a-8cf8-de1729407cf2 service nova] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 709.134918] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ce49b4e-0f0a-4814-be41-7eb7cb8f75b5 req-c24309d7-aeed-413a-8cf8-de1729407cf2 service nova] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 709.134967] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ce49b4e-0f0a-4814-be41-7eb7cb8f75b5 req-c24309d7-aeed-413a-8cf8-de1729407cf2 service nova] Enqueued Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 709.135512] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 709.135667] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 709.135759] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 709.136405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.136652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.136799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.137092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.137230] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.138158] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.138346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.138470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.138696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.139262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.139614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.139614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.139774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.139892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.140123] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.142016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.144531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.144695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.145164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.145164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f9ee58-2fed-4e58-a6bf-08bed37e3a39',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.146446] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.515092] env[65973]: INFO networking_nsxv3.common.synchronization [None req-174b434a-e129-4cf6-a718-de60a551577a None None] Enqueued Resource ID: 58715127-071e-4729-b53f-2e36a18ea77c with Priority: HIGHEST for action port [ 709.515682] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58715127-071e-4729-b53f-2e36a18ea77c with Priority: HIGHEST for action port [ 709.516161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-58715127-071e-4729-b53f-2e36a18ea77c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.516369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58715127-071e-4729-b53f-2e36a18ea77c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.516505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58715127-071e-4729-b53f-2e36a18ea77c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.516824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58715127-071e-4729-b53f-2e36a18ea77c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.517214] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58715127-071e-4729-b53f-2e36a18ea77c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.643189] env[65973]: INFO networking_nsxv3.common.synchronization [req-e0049706-29f1-42e3-99bd-e1272b6c0e1d req-ca72ab00-9070-44de-8efd-6f8845639f46 tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 709.643746] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 709.646574] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.646777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.646883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.647154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.647379] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.647531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.647648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.647847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.647981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.648139] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.649407] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.649508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.649726] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.655100] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with status ACTIVE [ 709.655236] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.655364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.655432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.655637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.655731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.655902] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.655999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.656079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.656253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.656340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.656546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.656670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.656734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.656881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.656971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.658946] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 is going to be updated. [ 709.661631] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.662443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.662560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.662797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.663318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.664041] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 709.691223] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.691455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.691455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.691903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.691903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.692029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.699712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.699862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.699904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.700136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.700283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.711385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 710.020540] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58715127-071e-4729-b53f-2e36a18ea77c [ 710.020947] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.021221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.021284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.021538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.021695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.021828] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58715127-071e-4729-b53f-2e36a18ea77c already deleted. [ 710.021937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58715127-071e-4729-b53f-2e36a18ea77c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.155927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.159119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.162089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.162089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.162089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.162089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.162089] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.162355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.162355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.162605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.162764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.162930] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 710.233334] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.240192] env[65973]: INFO networking_nsxv3.common.synchronization [req-f47c7075-9968-4b58-aa90-c5da97ee0ac2 req-33ecfc77-5084-46dc-950b-a04c914f9843 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 710.240930] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 710.241438] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.241438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.241438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.241638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.241936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.241936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.241936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.242099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.242202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.242327] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.245342] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 710.508869] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: SUCCESS [ 710.509227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.660917] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.661112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.661191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.661405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.661496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.661590] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be created. [ 710.689941] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.690220] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.690340] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.690646] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.691435] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.691604] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.691747] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.692063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.692240] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.692478] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.692595] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.692735] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.692850] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.693027] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.693119] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.693274] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.696229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.696229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.696229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.696229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.696229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.711238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: UNINITIALIZED for 2s [ 710.731303] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.731469] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.731600] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.731767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.732104] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.732275] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.732388] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.732728] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.732864] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b369e08e-28a0-4d3a-b46a-ee02c6e2f428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.745326] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.745484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.745564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.745866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.745866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.746061] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.746158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.746218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.746706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.746706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.746799] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 710.804664] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.804900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.805146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.805449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.805640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.817070] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 711.238155] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.238599] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.238876] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.239517] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.239587] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.239814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b369e08e-28a0-4d3a-b46a-ee02c6e2f428 not found, creating... [ 711.240253] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.240500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.241594] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.241738] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.241992] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.242535] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.242690] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.242856] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.243198] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.243477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.243593] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b369e08e-28a0-4d3a-b46a-ee02c6e2f428 is going to be created. [ 711.269387] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.269596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.269784] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.270249] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.270549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.270786] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.724788] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 711.724788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.725232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.727344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.727344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.727344] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.958273] env[65973]: INFO networking_nsxv3.common.synchronization [req-f47c7075-9968-4b58-aa90-c5da97ee0ac2 req-51268ecf-fa27-4243-8d49-20f6eb4a8053 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 711.961692] env[65973]: INFO networking_nsxv3.common.synchronization [req-f47c7075-9968-4b58-aa90-c5da97ee0ac2 req-51268ecf-fa27-4243-8d49-20f6eb4a8053 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 711.961692] env[65973]: INFO networking_nsxv3.common.synchronization [req-f47c7075-9968-4b58-aa90-c5da97ee0ac2 req-51268ecf-fa27-4243-8d49-20f6eb4a8053 service nova] Enqueued Resource ID: b369e08e-28a0-4d3a-b46a-ee02c6e2f428 with Priority: HIGHEST for action port [ 711.964063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 711.964063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 711.964063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b369e08e-28a0-4d3a-b46a-ee02c6e2f428 with Priority: HIGHEST for action port [ 711.964063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.964063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.964063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.964063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.964063] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.965400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.965693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.966104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.966429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.966650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.966974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.967173] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b369e08e-28a0-4d3a-b46a-ee02c6e2f428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.231118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.231264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.231334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.231561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.231728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.231832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.231903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.232332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.232503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.232599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.232695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.233495] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.233495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.233495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.233495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.233495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.233495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.233812] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.263936] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 712.264410] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e deletion is rescheduled due to dependency. [ 712.264487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.472274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.472274] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b369e08e-28a0-4d3a-b46a-ee02c6e2f428 with status ACTIVE [ 712.472274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.472274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.472274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.472274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.473963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.473963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.473963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.473963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.473963] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b369e08e-28a0-4d3a-b46a-ee02c6e2f428 is going to be updated. [ 712.495345] env[65973]: INFO networking_nsxv3.common.synchronization [None req-aad06e52-1df8-4cbd-b062-021a1bda02cd None None] Enqueued Resource ID: b3668fa3-5fa7-4ae2-9a57-103be6464cd2 with Priority: HIGHEST for action port [ 712.496717] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.496905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.497061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.497940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.498168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.498388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b369e08e-28a0-4d3a-b46a-ee02c6e2f428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.499556] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3668fa3-5fa7-4ae2-9a57-103be6464cd2 with Priority: HIGHEST for action port [ 712.499556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3668fa3-5fa7-4ae2-9a57-103be6464cd2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.499556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3668fa3-5fa7-4ae2-9a57-103be6464cd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.499556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3668fa3-5fa7-4ae2-9a57-103be6464cd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.499887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3668fa3-5fa7-4ae2-9a57-103be6464cd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.501105] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3668fa3-5fa7-4ae2-9a57-103be6464cd2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.721750] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 712.721750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.722049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.722082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.723489] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.723489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.723489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.723489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.723489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.723489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.723489] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.735366] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f329967-b7d9-481b-b6ad-3fa408a45e60: rpc.has_security_group_logging(os_id): False [ 712.759644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.759644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.760429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.760429] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.760429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.760429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.760429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.760599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.760759] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 712.827257] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.827428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.827471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.827671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.827811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.830570] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 712.830737] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 712.830817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.831403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.831596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.831767] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.831876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.831943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.832154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.832204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.832264] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.845623] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 713.003233] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3668fa3-5fa7-4ae2-9a57-103be6464cd2 [ 713.003608] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.003721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.003848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.004107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.004263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.004318] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3668fa3-5fa7-4ae2-9a57-103be6464cd2 already deleted. [ 713.004444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3668fa3-5fa7-4ae2-9a57-103be6464cd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.229106] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.229356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.229559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.229831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.230156] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.230339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.230397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.230801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.230801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.230864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.231097] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.231233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.232100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.232100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.232100] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.232100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.232100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.233959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.234106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.234294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.234395] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.336405] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.738397] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 713.759930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.759930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.759930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.759930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.759930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.760284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.760284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.760284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.760720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.760819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.760867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.761483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.761483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.761483] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.761483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.761483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.761860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.761860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.761860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be created. [ 713.843402] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.849911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.850133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.850133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.850757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.850757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.863516] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 713.920812] env[65973]: INFO networking_nsxv3.common.synchronization [req-69c24be4-8b0b-4abc-b0e1-a48e5134853f req-528901a7-c1d8-449c-a3f8-a21c5c3f107f tempest-ServerGroupTestJSON-213848519 tempest-ServerGroupTestJSON-213848519-project-member] Enqueued Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 713.921088] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 713.922081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.922081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.922081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.922081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.922441] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.922441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.922441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.922912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.922912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.923141] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.300559] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.300747] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-759" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.300871] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-759" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.301235] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-759" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.301494] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.301647] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.301756] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.302255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.302433] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.302652] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.302758] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.302856] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.302959] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.303075] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.303199] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.303618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.322381] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.322563] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.322696] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.322856] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-759" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.323179] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-5f842f12-ae6b-41ad-828e-5957d07d8587 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.323346] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.323457] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.323765] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.323896] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f842f12-ae6b-41ad-828e-5957d07d8587',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.348171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.348484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.348484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.348835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.348925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.349040] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 714.377996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.378161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.378232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.378416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.381230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.392033] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 714.425707] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.425856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.425911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.426148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.426241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.426433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.426534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.427118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.427118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.427118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.427118] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de already deleted. [ 714.427344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828238] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 5f842f12-ae6b-41ad-828e-5957d07d8587 not found, creating... [ 714.828238] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.828238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828647] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.828647] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.828813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.829035] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.829104] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.829254] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 5f842f12-ae6b-41ad-828e-5957d07d8587 is going to be created. [ 714.855493] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.855711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.855871] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.856331] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.856610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.856869] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.861400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 714.862346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.570440] env[65973]: INFO networking_nsxv3.common.synchronization [req-69c24be4-8b0b-4abc-b0e1-a48e5134853f req-da83e739-3d6e-47fd-b2fa-7c2f3e6e00de service nova] Enqueued Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_rules [ 715.570440] env[65973]: INFO networking_nsxv3.common.synchronization [req-69c24be4-8b0b-4abc-b0e1-a48e5134853f req-da83e739-3d6e-47fd-b2fa-7c2f3e6e00de service nova] Enqueued Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 715.570440] env[65973]: INFO networking_nsxv3.common.synchronization [req-69c24be4-8b0b-4abc-b0e1-a48e5134853f req-da83e739-3d6e-47fd-b2fa-7c2f3e6e00de service nova] Enqueued Resource ID: 5f842f12-ae6b-41ad-828e-5957d07d8587 with Priority: HIGHEST for action port [ 715.570440] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_rules [ 715.570440] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 715.570880] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f842f12-ae6b-41ad-828e-5957d07d8587 with Priority: HIGHEST for action port [ 715.570880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.571125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.571125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.573319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.573417] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.577742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.577742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.577742] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.577742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f842f12-ae6b-41ad-828e-5957d07d8587 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.577742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.577742] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f842f12-ae6b-41ad-828e-5957d07d8587',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.879186] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 715.879186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.059212] env[65973]: INFO networking_nsxv3.common.synchronization [req-771f773a-ee83-4c81-b9f3-5e8a132e08a4 req-c8a7efd5-4437-4d19-b22b-cc82f4d0403d tempest-ServersTestFqdnHostnames-1718908810 tempest-ServersTestFqdnHostnames-1718908810-project-member] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 716.059212] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 716.059212] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.060639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.060639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060639] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.078121] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.081225] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.082648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f842f12-ae6b-41ad-828e-5957d07d8587 with status ACTIVE [ 716.082837] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.082950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.083023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.083777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.083777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.083777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.083777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.083777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.084072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.084072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.086914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.087102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.087207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.087439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.087559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.087689] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f842f12-ae6b-41ad-828e-5957d07d8587 is going to be updated. [ 716.115405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.115405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.115405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.115574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.115642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.116468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f842f12-ae6b-41ad-828e-5957d07d8587" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.403048] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 716.403311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.403494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.403773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.404019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.404173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.404260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.404458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.404585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.404686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.404797] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.476856] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.477114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-741" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.477231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-741" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.477567] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-741" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.478256] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.478462] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.478608] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.478904] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.479292] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.479569] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.479972] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.480652] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.480652] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.480652] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.480652] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.480652] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.502168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.502308] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.502440] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.502611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-741" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.502929] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-58e90718-53c9-4bbf-a87a-87b5daa2a863 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.503107] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.503218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.503530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.503663] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e90718-53c9-4bbf-a87a-87b5daa2a863',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.562295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.562295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.562295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.562541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.562665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.562861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.562959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.563037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.563559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.563559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.563559] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f already deleted. [ 716.563559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.580669] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.909164] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.909469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.909469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.909769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.910032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.910303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.910303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.910512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.910671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.912021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.912021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.912021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.912421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.912421] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.006960] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.007288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.007391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.007668] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007952] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 58e90718-53c9-4bbf-a87a-87b5daa2a863 not found, creating... [ 717.008223] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.008368] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.008473] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.008724] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.008950] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.009161] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.009306] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.009412] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.009639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.010315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.010315] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 58e90718-53c9-4bbf-a87a-87b5daa2a863 is going to be created. [ 717.035152] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.035152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.035152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.035152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.035152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.035152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.084359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.084659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.084743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.085012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.085182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.085283] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de is going to be created. [ 717.146841] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.147071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.147071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.147320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.147524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.176841] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: UNINITIALIZED for 2s [ 717.416835] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 717.439505] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.439731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.439731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.439993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.439993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.440215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.440351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.440450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.440712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.440867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.441142] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.441249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.441312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.441467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.441546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.441804] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.441917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.441917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.442086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.442178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.442217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 717.515464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.515654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.515654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.515881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.516074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.537310] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 717.811932] env[65973]: INFO networking_nsxv3.common.synchronization [req-771f773a-ee83-4c81-b9f3-5e8a132e08a4 req-d0f3a695-3647-4306-b633-1914e9b3f25a service nova] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 717.812758] env[65973]: INFO networking_nsxv3.common.synchronization [req-771f773a-ee83-4c81-b9f3-5e8a132e08a4 req-d0f3a695-3647-4306-b633-1914e9b3f25a service nova] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 717.813187] env[65973]: INFO networking_nsxv3.common.synchronization [req-771f773a-ee83-4c81-b9f3-5e8a132e08a4 req-d0f3a695-3647-4306-b633-1914e9b3f25a service nova] Enqueued Resource ID: 58e90718-53c9-4bbf-a87a-87b5daa2a863 with Priority: HIGHEST for action port [ 717.814369] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_rules [ 717.815202] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 717.817862] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58e90718-53c9-4bbf-a87a-87b5daa2a863 with Priority: HIGHEST for action port [ 717.817862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.817862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.817862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.817862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.817862] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.822418] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.822418] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.822418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.822418] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.823295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-58e90718-53c9-4bbf-a87a-87b5daa2a863 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.824028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.824274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.825124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.825545] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e90718-53c9-4bbf-a87a-87b5daa2a863',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.332025] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.332025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.332025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58e90718-53c9-4bbf-a87a-87b5daa2a863 with status ACTIVE [ 718.332025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.332025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.332025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.332908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.332908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.332908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.332908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.332908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.332908] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58e90718-53c9-4bbf-a87a-87b5daa2a863 is going to be updated. [ 718.354201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.354347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.354406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.354619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.354894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.355081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58e90718-53c9-4bbf-a87a-87b5daa2a863" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.553025] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ea1c17b-9d09-44de-90ee-336a5614165b req-9f39ce04-dc2d-45cd-989b-6259827b252c tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 718.554152] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 718.554152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.554312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.554312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.554607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.555034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.555034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.555034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.555219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.555365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.555512] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.834422] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.040266] env[65973]: INFO networking_nsxv3.common.synchronization [req-f955071f-9eec-4713-a880-b1340027fe20 req-de7d2d80-2cd7-49af-9f42-54cb41fa11f8 tempest-ImagesNegativeTestJSON-745035862 tempest-ImagesNegativeTestJSON-745035862-project-member] Enqueued Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 719.040266] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGHEST for action security_group_members [ 719.040638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.040638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.040789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.040888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.041076] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.041183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.041241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.041442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.043267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.043267] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.057733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.057908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.058034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.058165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.058253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.058589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.058761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.059039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.059094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.059191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.059279] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 719.096913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.097335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.097426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.097652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.097792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.111082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 719.188294] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: SUCCESS [ 719.188493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.188663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.188926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.189190] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.189290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.189365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.189532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.190378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.190602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.190642] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.337311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.337467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.337539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.337759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.337855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.337952] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f is going to be created. [ 719.365703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.365875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.365946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.366180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.366343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.376262] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: UNINITIALIZED for 2s [ 719.548802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.548802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.548802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.548802] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b is going to be updated. [ 719.554991] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 719.555229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.574227] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.574411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.574629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.574749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.574916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.584174] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: IN_PROGRESS for 2s [ 719.692628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.692810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.692868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.693105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.693271] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.693369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.693426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.693578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.693717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.693746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.693884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.693976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694324] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.694415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.694782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.694926] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.197454] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de: rpc.has_security_group_logging(os_id): False [ 720.237900] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.238119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.238233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.238516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.238678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.239285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.239593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.239706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.239960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.240099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.240399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.240640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.241213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.241213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.241346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.241625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.241769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.241938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.242353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.242428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.242547] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de is going to be created. [ 720.338076] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.338343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.338435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.338709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.338886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.353385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: IN_PROGRESS for 2s [ 721.125377] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 721.125603] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 721.125714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.391591] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: SUCCESS [ 721.391951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.392169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.392384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.392587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.392693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.392753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.392902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.392991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393218] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.599758] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0397097b-0163-421f-b162-1b4a632f3e6b in Status: SUCCESS [ 721.600497] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b deletion is rescheduled due to dependency. [ 721.600497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.629520] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 721.629720] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 721.630284] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 721.631121] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 721.632416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.632603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.632636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.632835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.633010] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.633146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.633188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.633336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.633423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.633514] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.634477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.634594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.634647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.634863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.635016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.635122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.635172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.635771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.635771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.635771] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.686534] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 721.686642] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 721.686973] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_rules [ 721.687211] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 721.687353] env[65973]: INFO networking_nsxv3.common.synchronization [req-5368497e-8797-4342-8409-9f52bad505f0 req-293ea4d1-dd2f-479f-ae53-f585af4f5edf tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 721.688205] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 721.688449] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_rules [ 721.688559] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 721.688667] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 721.688809] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 721.689144] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.689248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.689314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.689601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.689696] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.690550] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.690663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.690730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.691059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.691114] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.692400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.692400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.692400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.692400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.692400] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f9ee58-2fed-4e58-a6bf-08bed37e3a39',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.692931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.692984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.694039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.694138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.896169] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.138620] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.139694] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.198526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.198697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.198907] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with status ACTIVE [ 722.199143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.199271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.199360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.199636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.199793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.200044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.200166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.200257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.200499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.200601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.201140] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.201140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.201827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.202070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.202182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.202288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 is going to be updated. [ 722.203760] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.203873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.251645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.251834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.251877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.252139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.252273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.252451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.388814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: SUCCESS [ 722.389062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.398601] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f: rpc.has_security_group_logging(os_id): False [ 722.432208] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.432360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.432422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.432648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.432741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.432992] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.436994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.436994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.436994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.436994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.436994] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f is going to be created. [ 722.510778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.511020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.511069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.511277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.511482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.524580] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: IN_PROGRESS for 2s [ 722.643245] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.645317] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.146724] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.146875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.146875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.147059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.147157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.147273] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 723.148936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.149148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.149148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.149333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.149484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.149484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be created. [ 723.180835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.180921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.181061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.181281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.181428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.184083] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.184241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.184302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.184965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.184965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.197679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 723.198742] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: UNINITIALIZED for 2s [ 724.179748] env[65973]: INFO networking_nsxv3.common.synchronization [req-d319e306-c4c4-404e-9580-5b25fc3446ee req-beba04b9-aa66-4743-881d-be8e4f0eb1ba tempest-ServerMetadataNegativeTestJSON-1670431293 tempest-ServerMetadataNegativeTestJSON-1670431293-project-member] Enqueued Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 724.180395] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 724.180866] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.182044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.182044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.182506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.182506] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.183415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.183415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.183415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.183415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.183415] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.540701] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: SUCCESS [ 724.540701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.689214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.689381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.690033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.690033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.690439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.690439] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.690439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.690439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.690642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.690695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.690780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 already deleted. [ 724.690864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.996663] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.996969] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-291" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.997817] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-291" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.000836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-291" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.000836] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.000836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.000836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.000836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.000836] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.000836] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.000836] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.001323] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.001531] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.001741] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.005028] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.005028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.059656] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.059656] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.061170] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.061170] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-291" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.061170] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.061170] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.061170] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.061170] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.061170] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306bf14c-35b3-4e1e-a4f6-06a3b0066c65',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.211830] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 725.211830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.211830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.211830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.211830] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.211830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.211830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.212493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.212493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.212493] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.214452] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 725.214452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.215993] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.215993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.217410] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.564171] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.564405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.564559] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.564975] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.565216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.565378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 not found, creating... [ 725.565637] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.565788] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.565901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.566143] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.566277] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.566555] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.566796] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.566929] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.567183] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.567395] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.567560] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 is going to be created. [ 725.589147] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.589259] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.589299] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.589574] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.589794] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.590049] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.720160] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.720160] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.221971] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.223069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.289866] env[65973]: INFO networking_nsxv3.common.synchronization [req-d319e306-c4c4-404e-9580-5b25fc3446ee req-510fbdb0-7e94-424a-b7de-809efa809738 service nova] Enqueued Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_rules [ 726.290240] env[65973]: INFO networking_nsxv3.common.synchronization [req-d319e306-c4c4-404e-9580-5b25fc3446ee req-510fbdb0-7e94-424a-b7de-809efa809738 service nova] Enqueued Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 726.290393] env[65973]: INFO networking_nsxv3.common.synchronization [req-d319e306-c4c4-404e-9580-5b25fc3446ee req-510fbdb0-7e94-424a-b7de-809efa809738 service nova] Enqueued Resource ID: 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 with Priority: HIGHEST for action port [ 726.291076] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_rules [ 726.291286] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 726.291455] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 with Priority: HIGHEST for action port [ 726.291936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.292059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.292144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.292500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.292621] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.293509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.293621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.293683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.294531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.294531] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.294531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.294531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.294531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.294531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.294531] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.296967] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.296967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.296967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.296967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.296967] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306bf14c-35b3-4e1e-a4f6-06a3b0066c65',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.726051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.726051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.726051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.726051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.726051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.726051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 726.727174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.727174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.727174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.729540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.730527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.730651] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 726.777294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.777699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.777699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.777818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.777860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.779774] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.779939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.780021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.792842] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 726.793223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 726.797230] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.798225] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.798388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.798582] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 with status ACTIVE [ 726.799368] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.799368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.799368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.799368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.799368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.799601] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.800466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.800466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.800466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.800466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.800466] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.800692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.800692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.800754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.802572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.802572] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 306bf14c-35b3-4e1e-a4f6-06a3b0066c65 is going to be updated. [ 726.828165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.828904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.828984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.829229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.829364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.829528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-306bf14c-35b3-4e1e-a4f6-06a3b0066c65" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.303093] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.809171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.809171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.809171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.809171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.809171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.809171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 is going to be created. [ 727.842725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.842725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.842725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.842725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.842725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.861038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: UNINITIALIZED for 2s [ 727.950355] env[65973]: INFO networking_nsxv3.common.synchronization [req-fe210335-08e6-4e5d-bfb8-d58f7d7129eb req-523463c7-e1f2-42d8-8344-e8177573a49b tempest-ServersTestManualDisk-443173538 tempest-ServersTestManualDisk-443173538-project-member] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 727.951288] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 727.951288] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.951490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.951490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.952538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.952538] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.952538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.952538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.952736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.952780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.952878] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.456454] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.456998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.456998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.457143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.457143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.457481] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.457627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.457716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.457938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.458133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.458202] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84af9696-6508-477b-a988-cda90bb86706 already deleted. [ 728.458325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.494882] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-469 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.495154] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-469" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.495303] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-469" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.495650] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-469" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.495893] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.496108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.496252] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.496506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.496713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.496967] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.497121] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.497256] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.497389] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.497525] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.497654] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.497814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.518422] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.518624] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.518813] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.519000] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-469" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.519454] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-e456ab03-c544-4e89-b438-6fb2b1da22c9 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.519629] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.519629] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.520044] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.520188] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e456ab03-c544-4e89-b438-6fb2b1da22c9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.805830] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 728.806121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.806302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.806551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.806780] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.807234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.807234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.807234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.807234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.807473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.807473] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.809014] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 728.809226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.809376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.811229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.811448] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.811691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.811691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.811821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.811889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.811982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.812091] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.000775] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-1bbece06-28ce-4baa-9298-fa9f15eb5a5c tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 729.001406] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 729.001703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.001827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.001902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.003523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.003677] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.004390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.005853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.006800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.006945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.007089] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.022716] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.022935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.023063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.023350] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.023507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.023668] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port e456ab03-c544-4e89-b438-6fb2b1da22c9 not found, creating... [ 729.023961] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.024183] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.024322] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.024548] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.024682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.024965] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.025165] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.025288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.025495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.025626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.025761] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: e456ab03-c544-4e89-b438-6fb2b1da22c9 is going to be created. [ 729.060138] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.060671] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.060869] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.062188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.062629] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.062749] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.314022] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.315201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315685] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.316115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.316115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.316203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.316307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.316393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.316449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.316583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.316712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.317332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.317332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.317332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.317332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.317332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.317332] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.509292] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.509292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.509579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.509579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.509652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.509810] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.509905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.509965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.510126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.510221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.510297] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 already deleted. [ 729.510354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.746937] env[65973]: INFO networking_nsxv3.common.synchronization [req-fe210335-08e6-4e5d-bfb8-d58f7d7129eb req-384fd206-336a-48de-bee1-423c555fe581 service nova] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 729.747139] env[65973]: INFO networking_nsxv3.common.synchronization [req-fe210335-08e6-4e5d-bfb8-d58f7d7129eb req-384fd206-336a-48de-bee1-423c555fe581 service nova] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 729.747270] env[65973]: INFO networking_nsxv3.common.synchronization [req-fe210335-08e6-4e5d-bfb8-d58f7d7129eb req-384fd206-336a-48de-bee1-423c555fe581 service nova] Enqueued Resource ID: e456ab03-c544-4e89-b438-6fb2b1da22c9 with Priority: HIGHEST for action port [ 729.747899] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_rules [ 729.747899] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 729.748053] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e456ab03-c544-4e89-b438-6fb2b1da22c9 with Priority: HIGHEST for action port [ 729.748527] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.748693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.748822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.749093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.749385] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.750554] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.750706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.750878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.751072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.753181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.753181] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.753181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e456ab03-c544-4e89-b438-6fb2b1da22c9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.753181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.753774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.753774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e456ab03-c544-4e89-b438-6fb2b1da22c9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.818814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccf5934e-9748-40f8-8554-93454e399b70: rpc.has_security_group_logging(os_id): False [ 729.820284] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 729.853898] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.854544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.854681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.854904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.854991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.855295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.855449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.855517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.855685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.855767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.855860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be created. [ 729.857922] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.858096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.858596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.858596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.858687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.858926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.859081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.859351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.859534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.859649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.859999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.860240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.860336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.860515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.860627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.860862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.861023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.861117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.861323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.861392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.861503] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 729.884699] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: SUCCESS [ 729.885798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.885798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.885798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.885798] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.886037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.886037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.886168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.886252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.886335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.886427] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.959063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.959063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.959305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.959366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.959540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.974391] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.974587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.974672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.975063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.975251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.985765] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 729.989374] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 730.169268] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.169414] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.169530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.169901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.170214] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.170379] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.170506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.170738] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.170882] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.171103] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.171212] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.171313] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.171457] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.171549] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.171624] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.171757] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.195391] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.195576] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.195748] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.195867] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.196312] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-b0e6ff5d-5167-430e-b1f7-511545f95220 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.196565] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.196705] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.197108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.197407] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e6ff5d-5167-430e-b1f7-511545f95220',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.255219] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.256420] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.256532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.256926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e456ab03-c544-4e89-b438-6fb2b1da22c9 with status ACTIVE [ 730.257137] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.257225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.257281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.257540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.257638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.257829] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.257944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.257991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.258161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.258228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.258404] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.258496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.258559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.258699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.258829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.258911] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e456ab03-c544-4e89-b438-6fb2b1da22c9 is going to be updated. [ 730.281617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.281617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.281617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.281863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.281911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.282139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e456ab03-c544-4e89-b438-6fb2b1da22c9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.390077] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.390077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.390077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.390389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.390389] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.390512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.390563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.390712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.390798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.390882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.391054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.391227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.391227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.391632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.391632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.391632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.391632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.391754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.391855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.391969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.392156] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.701029] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.701029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.701029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.701508] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.701578] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.701787] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port b0e6ff5d-5167-430e-b1f7-511545f95220 not found, creating... [ 730.702171] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.702406] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.702555] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.703174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.703174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.704034] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.704034] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.704252] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.704449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.704651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.704821] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: b0e6ff5d-5167-430e-b1f7-511545f95220 is going to be created. [ 730.734559] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.734784] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.734904] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.735266] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.735592] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.735698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.758426] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.899863] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8ee6965-6080-4005-80bf-0264af4bd437: rpc.has_security_group_logging(os_id): False [ 730.928835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.931367] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.931367] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.931367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.931777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.931777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.931777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.931777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.932700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.932700] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 is going to be created. [ 731.001011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.001011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.001011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.001011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.001011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.014659] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: IN_PROGRESS for 2s [ 731.260239] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.260392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.260462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.260763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.260873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.262072] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84af9696-6508-477b-a988-cda90bb86706 is going to be created. [ 731.293801] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.293957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.293999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.294684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.294684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.306352] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: UNINITIALIZED for 2s [ 731.463197] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-2cb486d1-06e4-4ed9-916e-baa69dea2df1 service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 731.463604] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-2cb486d1-06e4-4ed9-916e-baa69dea2df1 service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 731.463604] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-2cb486d1-06e4-4ed9-916e-baa69dea2df1 service nova] Enqueued Resource ID: b0e6ff5d-5167-430e-b1f7-511545f95220 with Priority: HIGHEST for action port [ 731.464343] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 731.464481] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 731.464605] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e6ff5d-5167-430e-b1f7-511545f95220 with Priority: HIGHEST for action port [ 731.464957] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.465183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.465343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.465575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.465849] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.467166] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.467166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.467166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.467395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.467616] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.467743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.467743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.470395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.470395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.470395] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.471428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e6ff5d-5167-430e-b1f7-511545f95220 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.471516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.471605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.471824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.472084] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e6ff5d-5167-430e-b1f7-511545f95220',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.974408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.974723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.974896] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.976774] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e6ff5d-5167-430e-b1f7-511545f95220 with status ACTIVE [ 731.976774] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.976936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.977226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.977321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.977457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.977693] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.977836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.977922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.982564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.982678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.983218] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.984316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.984316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.984316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.984549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e6ff5d-5167-430e-b1f7-511545f95220 is going to be updated. [ 732.002677] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 732.002908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.004895] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 732.005114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.010141] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.010289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.010360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.010563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.010702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.010873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e6ff5d-5167-430e-b1f7-511545f95220" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.487776] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.495569] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 732.495683] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 732.495828] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 732.496432] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 732.496566] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 732.496665] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 732.499466] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d1f177-ec77-4d3a-bc27-48a23b238428 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.499638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.499788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.500131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.501034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.501161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.501234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.501447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.501583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.501656] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.502647] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.502781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.502853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.503128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.503350] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.503463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.503529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.503684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.503785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.503883] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.505163] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505900] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.549556] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_rules [ 732.549814] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 732.550016] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 732.550302] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 732.550464] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_rules [ 732.550586] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 732.550707] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8f9bb6b-83e7-4219-a98c-673f493890af req-41b08997-8a9e-44f4-9804-505267a14fdd tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 732.551272] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_rules [ 732.551400] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 732.551835] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 732.552035] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with Priority: HIGHEST for action port [ 732.552155] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_rules [ 732.552252] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 732.552342] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 732.552692] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d1f177-ec77-4d3a-bc27-48a23b238428 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.552855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.552927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.556680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.556680] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f9ee58-2fed-4e58-a6bf-08bed37e3a39',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.557450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.557450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.557450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.558319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.558319] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.561255] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d1f177-ec77-4d3a-bc27-48a23b238428 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.561255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.561255] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.561255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.998572] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.998572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.998572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.998572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.998572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.998572] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be created. [ 733.009060] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.009674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.010549] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.034016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.034016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.034016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.034016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.034016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.038116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: SUCCESS [ 733.038116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.050354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: UNINITIALIZED for 2s [ 733.062077] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d1f177-ec77-4d3a-bc27-48a23b238428 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.062203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.062462] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.062550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.062723] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 with status ACTIVE [ 733.062938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.063061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.063061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.063281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.063395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.063579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.064141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.064141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.064141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.064141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.064301] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.064301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.064378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.064466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.064540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.064625] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f9ee58-2fed-4e58-a6bf-08bed37e3a39 is going to be updated. [ 733.076260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.077445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.090609] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.090804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.090907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.091666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.091773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.092085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f9ee58-2fed-4e58-a6bf-08bed37e3a39" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.127964] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-3e03744d-f49a-47b8-8bb2-b927cd2a9ccd tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 733.129091] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 733.130857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.133022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.318080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: SUCCESS [ 733.318309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.318475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.320170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.320651] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.320651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.320651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.321169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.321341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.321400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.321497] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.515784] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.515784] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.515784] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.618692] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.619017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.619289] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.619649] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.620055] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.620306] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.620507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.620809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.621102] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.621473] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.621691] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.621817] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.621940] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.622107] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.622179] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.622321] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.644114] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.644338] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.644487] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.644690] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.645095] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-608eb727-3770-4e19-b3e0-659e19df2e34 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.645265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.645455] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.645790] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.649249] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('608eb727-3770-4e19-b3e0-659e19df2e34',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.823826] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.017972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.018425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.018425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.018561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.018706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.018910] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 734.020328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.020449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.020503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.020687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.020774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.020866] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 is going to be created. [ 734.022111] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.022236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.022339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.022674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.022674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.022790] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 734.058240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.058455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.058497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.058751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.059014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.061551] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.061760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.061760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.061929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.062084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.063876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.064050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.064111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.064313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.064512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.077094] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 734.077094] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 734.077675] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: UNINITIALIZED for 2s [ 734.151835] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.152172] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.152304] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.152602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.152755] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.152927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 608eb727-3770-4e19-b3e0-659e19df2e34 not found, creating... [ 734.153247] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.153409] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.153534] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.153766] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.153944] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.154344] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.154533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.154642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.154859] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.155026] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.155171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 608eb727-3770-4e19-b3e0-659e19df2e34 is going to be created. [ 734.181515] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.181750] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.181932] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.182256] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.182499] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.182791] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.326299] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84af9696-6508-477b-a988-cda90bb86706: rpc.has_security_group_logging(os_id): False [ 734.350954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.351150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.351316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.351449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.351542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.351796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.352114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.352114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.352235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.352235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.352318] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84af9696-6508-477b-a988-cda90bb86706 is going to be created. [ 734.424085] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.424253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.424322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.424550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.424758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.438467] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: IN_PROGRESS for 2s [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-94c9ca39-a21f-4ba8-9ae5-e6e80f67ad5e service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-94c9ca39-a21f-4ba8-9ae5-e6e80f67ad5e service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-94c9ca39-a21f-4ba8-9ae5-e6e80f67ad5e service nova] Enqueued Resource ID: 608eb727-3770-4e19-b3e0-659e19df2e34 with Priority: HIGHEST for action port [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 734.914089] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 608eb727-3770-4e19-b3e0-659e19df2e34 with Priority: HIGHEST for action port [ 734.915198] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.915529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.916485] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.916774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.917146] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-608eb727-3770-4e19-b3e0-659e19df2e34 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.917468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.917622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.917980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.918314] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('608eb727-3770-4e19-b3e0-659e19df2e34',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.062041] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.062041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.062041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.062041] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.062973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.063598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.063719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.063823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.063823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.064041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.064041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.064164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.422838] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 608eb727-3770-4e19-b3e0-659e19df2e34 with status ACTIVE [ 735.423140] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.423547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.423547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.423703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.423735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.423909] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.424033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.424123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.424881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.424881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.424881] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.425064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.425105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.425291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.425409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.425794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 608eb727-3770-4e19-b3e0-659e19df2e34 is going to be updated. [ 735.452600] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.452600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.452863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.453019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.453199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.453394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-608eb727-3770-4e19-b3e0-659e19df2e34" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.566394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.567170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.567170] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.072059] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.089332] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 736.089559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.090163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.090402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.090612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.090761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.090854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.091071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.091185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.091294] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.093043] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 736.093304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.094174] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: SUCCESS [ 736.094411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.094596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.094884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.095296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.096128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.096203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.096529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.096732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.096819] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.097890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.098710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.098981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.099519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.099618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.099982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.101146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.101146] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.456695] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: SUCCESS [ 736.456967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.574099] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.574099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.574099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.574332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.574332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.574414] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 736.607102] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.607102] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.607102] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.607102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.608035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.608035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.608427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.608645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.620187] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 737.115674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.115674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.115674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.615772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.615988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.615988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.616287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.616403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.616667] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 737.619050] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.619050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.619329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.619372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.619465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.619573] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 737.621612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.621816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.621873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.622235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.622411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.623042] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 is going to be updated. [ 737.668644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.668644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.668644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.668644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.668644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.671920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.671920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.671920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.671920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.671920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.674289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.674494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.674554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.674813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.675032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.692121] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: IN_PROGRESS for 2s [ 737.693355] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 737.694405] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 738.523518] env[65973]: INFO networking_nsxv3.common.synchronization [None req-65625c6d-cadb-4d03-9334-f2077d36342e None None] Enqueued Resource ID: 7672ff9f-cfa1-4afe-a2d8-30195079f892 with Priority: HIGHEST for action port [ 738.525143] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7672ff9f-cfa1-4afe-a2d8-30195079f892 with Priority: HIGHEST for action port [ 738.525522] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7672ff9f-cfa1-4afe-a2d8-30195079f892 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.526192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7672ff9f-cfa1-4afe-a2d8-30195079f892" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.526192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7672ff9f-cfa1-4afe-a2d8-30195079f892" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.526192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7672ff9f-cfa1-4afe-a2d8-30195079f892" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.526192] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7672ff9f-cfa1-4afe-a2d8-30195079f892',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.562868] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-c574ea5f-0e07-4c5e-8441-35d5c912d3ad tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 738.563701] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 738.563822] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.564108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.631490] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 738.632980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.633641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.633857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.634104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.634202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.634246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.634387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.634468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.634560] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.030648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7672ff9f-cfa1-4afe-a2d8-30195079f892 [ 739.030648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.030648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.030648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.030648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.030648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.030648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7672ff9f-cfa1-4afe-a2d8-30195079f892 already deleted. [ 739.030648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7672ff9f-cfa1-4afe-a2d8-30195079f892" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.138545] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.160721] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.160721] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.160721] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.160721] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.164397] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.164397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.164397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.164607] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.164689] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.164891] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.165019] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.165125] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.165256] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.166032] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.166032] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.166032] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.188399] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.188705] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.188705] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.188974] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-976" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.189360] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-203205dc-c39f-44d0-bccf-5fbe290e7510 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.189563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.189682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.190142] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.190255] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203205dc-c39f-44d0-bccf-5fbe290e7510',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.385093] env[65973]: INFO networking_nsxv3.common.synchronization [req-19e64d7a-d0bd-418d-8a8a-3f3b328ec0c5 req-23a5117f-a419-4c3e-8ead-7712b6849ae8 tempest-FloatingIPsAssociationTestJSON-1939154346 tempest-FloatingIPsAssociationTestJSON-1939154346-project-member] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 739.385678] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 739.386035] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.386193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.386284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.386507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.386688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.386793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.386874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.387041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.387134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.387228] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.640409] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.699033] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.699033] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 203205dc-c39f-44d0-bccf-5fbe290e7510 not found, creating... [ 739.699033] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.699033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.700843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.705397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.705397] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.705397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.705397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.705397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.705397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.705397] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 203205dc-c39f-44d0-bccf-5fbe290e7510 is going to be created. [ 739.727547] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: SUCCESS [ 739.727900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.728180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.728511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.728902] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.729103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.729216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.729704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.729870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.730027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.730178] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.732553] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 739.732553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.733245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 739.733736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.733736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.734234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.734479] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.734677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.734759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.735016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.735145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.735277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.735439] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.736442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.736841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.737231] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.737231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.737356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.737558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.737726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.737837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.738535] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.746734] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.746963] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.747174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.747387] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.747614] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.748147] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.889897] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.144340] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.144340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.144340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.144686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.144686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.144791] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 740.177895] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.178076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.178076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.178268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.178430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.190354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 740.240284] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.241307] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.241937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.242067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.242529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.242529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.242529] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.243657] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.243657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.243657] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.244098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.244098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.244098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.244098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.244098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.244230] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.395897] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.484623] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ecf70453-174e-4db8-bb42-82388888d502 None None] Enqueued Resource ID: bf9368fc-cd83-4647-953f-b03e6bf680ec with Priority: HIGHEST for action port [ 740.485175] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9368fc-cd83-4647-953f-b03e6bf680ec with Priority: HIGHEST for action port [ 740.485486] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf9368fc-cd83-4647-953f-b03e6bf680ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.485606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf9368fc-cd83-4647-953f-b03e6bf680ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.485673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf9368fc-cd83-4647-953f-b03e6bf680ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.485944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf9368fc-cd83-4647-953f-b03e6bf680ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.486047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9368fc-cd83-4647-953f-b03e6bf680ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.515449] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-3a1c9031-e017-4062-a756-eb620424d7b3 service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 740.515655] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-3a1c9031-e017-4062-a756-eb620424d7b3 service nova] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 740.515821] env[65973]: INFO networking_nsxv3.common.synchronization [req-2d3c1c21-1e64-4d7a-a3cf-316fdf9d7ca2 req-3a1c9031-e017-4062-a756-eb620424d7b3 service nova] Enqueued Resource ID: 203205dc-c39f-44d0-bccf-5fbe290e7510 with Priority: HIGHEST for action port [ 740.516364] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_rules [ 740.516539] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 740.516644] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203205dc-c39f-44d0-bccf-5fbe290e7510 with Priority: HIGHEST for action port [ 740.517024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.517160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.517336] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.517490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.517708] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-203205dc-c39f-44d0-bccf-5fbe290e7510 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.517881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.517981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.518216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.518303] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203205dc-c39f-44d0-bccf-5fbe290e7510',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.742450] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78d1f177-ec77-4d3a-bc27-48a23b238428: rpc.has_security_group_logging(os_id): False [ 740.745793] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccf5934e-9748-40f8-8554-93454e399b70: rpc.has_security_group_logging(os_id): False [ 740.747114] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 740.769250] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.769250] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.769250] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.769250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.770054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.770054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.770054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.770054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.770054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.770054] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 740.771718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.771718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.771718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.771718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.771718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.772234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.772234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.772234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.772339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.772927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.772927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 is going to be created. [ 740.775203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.775203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.775203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.775545] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 740.866026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.866026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.866026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.866026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.866026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.876596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.876775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.876881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.877132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.877302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.882487] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.882709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.882709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.882922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.883094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.899043] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: IN_PROGRESS for 2s [ 740.899773] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.899956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.900035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.900378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.900429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.900518] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be updated. [ 740.917916] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 740.918620] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 740.934050] env[65973]: INFO networking_nsxv3.common.synchronization [req-97274583-b7e3-4720-a3d2-09898a84e635 req-930febfd-0186-4f91-8bae-f477366c66e6 tempest-ServerMetadataTestJSON-546650741 tempest-ServerMetadataTestJSON-546650741-project-member] Enqueued Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 740.934766] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 740.936052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.936052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.936052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.936052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.936052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.936052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.936052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.937129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.937129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.937129] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.953142] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.953297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.953388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.953593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.953714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.965557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 740.987764] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf9368fc-cd83-4647-953f-b03e6bf680ec [ 740.988609] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.988609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.988609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.988609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.988609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.988953] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf9368fc-cd83-4647-953f-b03e6bf680ec already deleted. [ 740.988953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf9368fc-cd83-4647-953f-b03e6bf680ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.022388] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 203205dc-c39f-44d0-bccf-5fbe290e7510 with status ACTIVE [ 741.022665] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.022893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.022893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.023126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.023220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.023405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.023511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.023583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.023718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.023798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.024057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.024189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.024189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.024276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.024354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.024422] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 203205dc-c39f-44d0-bccf-5fbe290e7510 is going to be updated. [ 741.059092] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.059092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.059092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.059092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.059092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.059092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203205dc-c39f-44d0-bccf-5fbe290e7510" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.281499] env[65973]: INFO networking_nsxv3.common.synchronization [None req-fba96ee9-d525-4761-9c71-f89f8599ceaf tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 741.282097] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 741.282417] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.282536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.282594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.282859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.282943] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.440079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.440273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.440390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.441343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.441343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.441343] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.441343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.441343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.441744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.441744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.441801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 already deleted. [ 741.441874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.472100] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a6a50e49-b8ab-40b8-b452-c733edc3b6d1 tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 914de0ab-94e1-4600-8166-4b8f1a49557d with Priority: HIGHEST for action security_group_rules [ 741.473340] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914de0ab-94e1-4600-8166-4b8f1a49557d with Priority: HIGHEST for action security_group_rules [ 741.474637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-914de0ab-94e1-4600-8166-4b8f1a49557d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.474637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.474637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.474637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.474637] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('914de0ab-94e1-4600-8166-4b8f1a49557d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.537362] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.537643] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-327" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.537835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-327" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.538362] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-327" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.538782] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.539099] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.539655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.539716] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.539963] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.540344] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.540344] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.540491] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.540548] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.540643] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.540739] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.541745] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.565215] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.565215] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.565215] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.565215] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-327" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.565215] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b193a074-4731-4a21-9873-45c3ff790601 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.565215] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.565620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.565620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.566394] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b193a074-4731-4a21-9873-45c3ff790601',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.614277] env[65973]: INFO networking_nsxv3.common.synchronization [None req-903b2e67-c5c8-47d5-8c42-f0020e256876 tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 741.615183] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 741.615502] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.615845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.755816] env[65973]: INFO networking_nsxv3.common.synchronization [None req-73206c08-57f6-4c7f-b97a-faf0d17c905d tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 914de0ab-94e1-4600-8166-4b8f1a49557d with Priority: HIGHEST for action security_group_rules [ 741.758021] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914de0ab-94e1-4600-8166-4b8f1a49557d with Priority: HIGHEST for action security_group_rules [ 741.758021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-914de0ab-94e1-4600-8166-4b8f1a49557d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.758021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.810784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.810947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.811030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.811259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.811349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.811442] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db already deleted. [ 741.811526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.811680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.811836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.811920] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.995271] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.995413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.995485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.995707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.995922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.996050] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 914de0ab-94e1-4600-8166-4b8f1a49557d already deleted. [ 741.996144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.996290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.996456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.996538] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('914de0ab-94e1-4600-8166-4b8f1a49557d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.069731] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.070035] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.070164] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.070441] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.070583] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.070725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b193a074-4731-4a21-9873-45c3ff790601 not found, creating... [ 742.070972] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.071134] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.071256] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.071471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.071602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.071869] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.072027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.072140] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.072336] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.072464] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.072591] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b193a074-4731-4a21-9873-45c3ff790601 is going to be created. [ 742.097429] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.097652] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.097764] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.098008] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.098246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.098456] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.201939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 742.202182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.202360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.202705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.202705] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.202887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.202887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.203091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.203267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.203328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.203455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.203547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.203640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.203872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.204082] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.204236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.204308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.204514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.204583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.204672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.204757] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.205748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.205920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.206091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.206290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.206290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.206429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.206504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.206615] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.343751] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.343923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.343963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.344189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.344283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.344392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db already deleted. [ 742.344474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.517611] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.517866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.517997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.518373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.518531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.518679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 914de0ab-94e1-4600-8166-4b8f1a49557d already deleted. [ 742.518812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-914de0ab-94e1-4600-8166-4b8f1a49557d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.709798] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13b6ff97-cb4a-4c76-b07b-2e08a7615d07: rpc.has_security_group_logging(os_id): False [ 742.710074] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.730800] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.730956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.731045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.731239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.731332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.731556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.731711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.731711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.731887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.731923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.733444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.733444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.733444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.733444] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be created. [ 742.806749] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.807060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.807060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.807200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.807401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.811494] env[65973]: INFO networking_nsxv3.common.synchronization [req-97274583-b7e3-4720-a3d2-09898a84e635 req-ff78101f-2f0f-4718-9127-a0377bd34316 service nova] Enqueued Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_rules [ 742.813932] env[65973]: INFO networking_nsxv3.common.synchronization [req-97274583-b7e3-4720-a3d2-09898a84e635 req-ff78101f-2f0f-4718-9127-a0377bd34316 service nova] Enqueued Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 742.813932] env[65973]: INFO networking_nsxv3.common.synchronization [req-97274583-b7e3-4720-a3d2-09898a84e635 req-ff78101f-2f0f-4718-9127-a0377bd34316 service nova] Enqueued Resource ID: b193a074-4731-4a21-9873-45c3ff790601 with Priority: HIGHEST for action port [ 742.815931] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_rules [ 742.816537] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 742.818673] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b193a074-4731-4a21-9873-45c3ff790601 with Priority: HIGHEST for action port [ 742.819057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.819196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.819265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.819515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.819611] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.820522] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.820655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.820696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.820869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.821016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.821111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.821165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.824128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.824128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.824128] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.824128] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b193a074-4731-4a21-9873-45c3ff790601 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.824128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.824128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.825867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.825867] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b193a074-4731-4a21-9873-45c3ff790601',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.828972] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 742.928326] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: SUCCESS [ 742.928585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.934614] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 742.934838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.938707] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 742.939067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.983016] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 742.983249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.213394] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.328288] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.328288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.332587] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b193a074-4731-4a21-9873-45c3ff790601 with status ACTIVE [ 743.332587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.332587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.332587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.332587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.332587] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b193a074-4731-4a21-9873-45c3ff790601 is going to be updated. [ 743.333278] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.354477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.354661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.354701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.354894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.355083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.355253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b193a074-4731-4a21-9873-45c3ff790601" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.388756] env[65973]: INFO networking_nsxv3.common.synchronization [req-0272579c-d6b5-4465-a405-573c6ca8c05a req-ab1e0958-e459-4106-b577-86b32baf3f72 tempest-ServersAdminNegativeTestJSON-821105226 tempest-ServersAdminNegativeTestJSON-821105226-project-member] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 743.389313] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 743.389617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.389733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.389799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.390014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.390407] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.390575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.390679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.390888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.391036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.391175] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.634943] env[65973]: INFO networking_nsxv3.common.synchronization [req-638c51d2-fa1a-4539-bb6d-dfb136f44a11 req-a0ccbd22-1f4a-421f-8e64-405a2c558c3f tempest-ServerGroupTestJSON-213848519 tempest-ServerGroupTestJSON-213848519-project-member] Enqueued Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 743.635528] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGHEST for action security_group_members [ 743.635830] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.635953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.636176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.636438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.636644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.636815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.636914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.637123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.637262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.637397] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.718503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.718784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.719292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.719580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.719929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.719929] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 743.755518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.755739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.755813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.756030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.756359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.769720] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 743.835637] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.894228] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.139988] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.140337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.140337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.140454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.140540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.140734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.140841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.140908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.141303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.141303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.141303] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de is going to be updated. [ 744.172541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.172809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.172809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.173054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.173264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.184902] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: IN_PROGRESS for 2s [ 744.337999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.338213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.338254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.338477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.338568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.338665] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 is going to be created. [ 744.365384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.365622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.365622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.365830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.365993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.378722] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: UNINITIALIZED for 2s [ 744.397588] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.849937] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 744.849937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.849937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.849937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.850327] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.907894] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.907894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.907894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.907894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.907894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.907894] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be updated. [ 744.960882] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.961143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.961143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.962022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.962022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.973687] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 745.355504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.355670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.370111] env[65973]: INFO networking_nsxv3.common.synchronization [req-20176590-c009-4601-a1f9-6e50cf79cc9d req-cdf97d4a-704e-44b6-b4e9-639e63bc3df7 tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 745.372637] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 745.372637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.372637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.372637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.372637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.373751] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.373905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.373956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.374471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.374471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.374562] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.782044] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 745.782195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.782254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.782499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.782675] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.783610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.783610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.783610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.783610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.783610] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.877478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.877833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.877833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.877928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.878036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.878276] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.878343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.878419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.878652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.878768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.878915] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec already deleted. [ 745.879062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.997541] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.998375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.998606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.999153] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.999623] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.999901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.000108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.000498] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.000730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.001883] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.002241] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.002348] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.002534] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.002714] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.002891] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.003397] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.060932] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.060932] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.060932] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.060932] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.060932] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-05e27261-4854-475d-8f11-799aca744659 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.061833] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.061833] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.062070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.062298] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05e27261-4854-475d-8f11-799aca744659',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.203194] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de in Status: SUCCESS [ 746.203452] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de deletion is rescheduled due to dependency. [ 746.203589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.228662] env[65973]: INFO networking_nsxv3.common.synchronization [req-fd2f8318-68b1-41ae-ba73-f045f00d1d55 req-067f0857-d1cb-4be3-b859-b7db7774831d tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 746.229449] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 746.229785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.229977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.230075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.230313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.230512] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.230627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.230704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.230906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.231024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.231146] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.286346] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.389275] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: SUCCESS [ 746.389631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.389855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.390058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.390277] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.390420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.390495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.390676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.390761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.390848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.390939] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.564705] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.564981] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.565182] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.565657] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.565749] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.565909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 05e27261-4854-475d-8f11-799aca744659 not found, creating... [ 746.566195] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.566364] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.566495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.566775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.566950] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.568014] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.568199] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.568316] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.568539] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.568672] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.568807] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 05e27261-4854-475d-8f11-799aca744659 is going to be created. [ 746.588773] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.589088] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.589233] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.589640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.589888] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.590127] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.733478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.733679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.733761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.734057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.734555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.734555] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.734555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.734555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.734807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.734807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.734951] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 746.776687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.776901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.776901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.777094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.777242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.788521] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 746.789930] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.896059] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.896373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.896373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.896572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.896705] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.896837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.896926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.897155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.897246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.897296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.897416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.897510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.897574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.897772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.897962] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.898083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.898165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.898319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.898425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.898515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.898607] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.987863] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 746.987863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.154885] env[65973]: INFO networking_nsxv3.common.synchronization [req-c49ac75f-28ff-45a1-83dd-2f82a1f2b692 req-4b2b09d6-110d-44af-af86-e46e304da891 tempest-FloatingIPsAssociationNegativeTestJSON-122133943 tempest-FloatingIPsAssociationNegativeTestJSON-122133943-project-member] Enqueued Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 747.155425] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGHEST for action security_group_members [ 747.155728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.155848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.155910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.156119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.156269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.156367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.156429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.156708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.156708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.156778] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.292688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.292688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.292688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.292888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.292920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.293009] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 747.318678] env[65973]: INFO networking_nsxv3.common.synchronization [req-20176590-c009-4601-a1f9-6e50cf79cc9d req-00e4513a-531e-47e2-aabd-095b7e585942 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 747.318737] env[65973]: INFO networking_nsxv3.common.synchronization [req-20176590-c009-4601-a1f9-6e50cf79cc9d req-00e4513a-531e-47e2-aabd-095b7e585942 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 747.318945] env[65973]: INFO networking_nsxv3.common.synchronization [req-20176590-c009-4601-a1f9-6e50cf79cc9d req-00e4513a-531e-47e2-aabd-095b7e585942 service nova] Enqueued Resource ID: 05e27261-4854-475d-8f11-799aca744659 with Priority: HIGHEST for action port [ 747.321726] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 747.321726] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 747.321726] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05e27261-4854-475d-8f11-799aca744659 with Priority: HIGHEST for action port [ 747.321726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.321726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.321726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.323112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.323112] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.325533] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.325533] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.325533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.325533] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.326269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-05e27261-4854-475d-8f11-799aca744659 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.326367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.326367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.327533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.327533] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05e27261-4854-475d-8f11-799aca744659',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.339223] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.339223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.339223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.339514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.339514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.353969] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 747.402922] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa2f368-d181-4d10-aca0-43e8bff0fa28: rpc.has_security_group_logging(os_id): False [ 747.421476] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.421657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.421721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.422009] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.422218] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.422374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.422455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.422569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.422648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.422830] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.422922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.422981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.423145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.423219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.423410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.423507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.423733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.423733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.423796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.423877] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 is going to be created. [ 747.485099] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.485320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.485386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.485956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.485956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.500653] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: IN_PROGRESS for 2s [ 747.658499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.658678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.658728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.658990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.659106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.659314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.659413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.659521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.659632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.659708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.659797] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b19a464-262b-473d-9f50-535013bda763 is going to be updated. [ 747.696182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.696327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.696419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.699785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.699785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.710305] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: IN_PROGRESS for 2s [ 747.827981] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.829079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.829196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.829625] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05e27261-4854-475d-8f11-799aca744659 with status ACTIVE [ 747.829691] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.829791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.830174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.830174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.830174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.830464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.830464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.830580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.830832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.830832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.830943] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.830943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.831167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.831167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.831272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.831301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05e27261-4854-475d-8f11-799aca744659 is going to be updated. [ 747.857056] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.857437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.857515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.857730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.857869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.858320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05e27261-4854-475d-8f11-799aca744659" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.330907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.735543] env[65973]: INFO networking_nsxv3.common.synchronization [None req-45a69229-ad10-4c7b-87eb-b73ad1214ea8 None None] Enqueued Resource ID: 318760be-a7eb-43bc-aef9-16946deca6d8 with Priority: HIGHEST for action port [ 748.735543] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 318760be-a7eb-43bc-aef9-16946deca6d8 with Priority: HIGHEST for action port [ 748.735543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-318760be-a7eb-43bc-aef9-16946deca6d8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.735543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-318760be-a7eb-43bc-aef9-16946deca6d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.735894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-318760be-a7eb-43bc-aef9-16946deca6d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.736214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-318760be-a7eb-43bc-aef9-16946deca6d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.736381] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('318760be-a7eb-43bc-aef9-16946deca6d8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.801786] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 748.802069] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c deletion is rescheduled due to dependency. [ 748.802187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.833523] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.833774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.833774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.833933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.834053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.834152] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be created. [ 748.860637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.860824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.860883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.861094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.861345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.871874] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: UNINITIALIZED for 2s [ 749.240750] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 318760be-a7eb-43bc-aef9-16946deca6d8 [ 749.241226] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.241459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.241574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.241860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.242071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.242230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:318760be-a7eb-43bc-aef9-16946deca6d8 already deleted. [ 749.242348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-318760be-a7eb-43bc-aef9-16946deca6d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.364687] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 749.364687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.364687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.365130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.365130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.365218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.365249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.365393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.365473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.368622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.368622] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.513764] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: SUCCESS [ 749.514024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.719506] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b19a464-262b-473d-9f50-535013bda763 in Status: SUCCESS [ 749.719682] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b19a464-262b-473d-9f50-535013bda763 deletion is rescheduled due to dependency. [ 749.719797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.872180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.872180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.872180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.872180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.872180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.872180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.872180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.872589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.872589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.872589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.872672] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.872712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.872773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.873962] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.873962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.873962] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.378543] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13b6ff97-cb4a-4c76-b07b-2e08a7615d07: rpc.has_security_group_logging(os_id): False [ 750.405490] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.405697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.405774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.405959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.406062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.406330] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.406453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.406513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.406704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.406798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.407011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.408176] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.408176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.408176] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 750.564165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.564165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.564165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.564165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.564165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.578027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 750.885863] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 750.886062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.886606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.887088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.887088] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.887232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.887276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.887446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.887796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.887796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.887796] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.277511] env[65973]: INFO networking_nsxv3.common.synchronization [None req-822f2c29-9306-4821-b86c-e50e774a38d0 None None] Enqueued Resource ID: 55518da6-5e52-4f14-8ee8-70b7fbdc05fe with Priority: HIGHEST for action port [ 751.278197] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55518da6-5e52-4f14-8ee8-70b7fbdc05fe with Priority: HIGHEST for action port [ 751.278584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-55518da6-5e52-4f14-8ee8-70b7fbdc05fe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.278726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55518da6-5e52-4f14-8ee8-70b7fbdc05fe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.278823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55518da6-5e52-4f14-8ee8-70b7fbdc05fe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.279143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55518da6-5e52-4f14-8ee8-70b7fbdc05fe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.279237] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55518da6-5e52-4f14-8ee8-70b7fbdc05fe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.391426] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.782335] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55518da6-5e52-4f14-8ee8-70b7fbdc05fe [ 751.782530] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.782655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.782723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.782945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.783053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.783150] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55518da6-5e52-4f14-8ee8-70b7fbdc05fe already deleted. [ 751.783230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55518da6-5e52-4f14-8ee8-70b7fbdc05fe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.896882] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a7ed067-ae07-49f5-b03a-aa95774538ec: rpc.has_security_group_logging(os_id): False [ 751.918778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.918778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.918778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.918778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.918778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.919241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.919414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.919493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.919710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.919842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.919898] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be created. [ 752.001598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.001776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.001868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.002176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.002410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.017243] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 752.595422] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 752.596453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.596453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.596453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.596453] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.100186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.100186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.100186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.100433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.100648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.101045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.101045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.101182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.101300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.101540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.101611] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.604324] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.604760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.604760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.604760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.604879] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.604987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.605860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.605860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.605860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.605860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.606111] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.606111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.606111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.606236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.606400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.606502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.606552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.607067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.607067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.607067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.607067] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.032101] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 754.032323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.109554] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13b6ff97-cb4a-4c76-b07b-2e08a7615d07: rpc.has_security_group_logging(os_id): False [ 754.134023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.135789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.135789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.136563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.136563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.136563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.136671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.136754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.136933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.137050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.137255] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.137380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.137514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.138033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.138472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.138472] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 754.213141] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.213141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.213141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.213141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.213141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 754.716016] env[65973]: INFO networking_nsxv3.common.synchronization [req-83b0c959-2dd7-439d-8743-dec0fd73da8b req-22280cfd-0891-44a2-9103-83a5613ed08c tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 754.716540] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 754.716852] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.716991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.717083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.717337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.717757] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.717873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.717940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.718119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.718207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.718304] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.220678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.220915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.221015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.221325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.221325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.221629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.221726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.221788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.221957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.224010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.224193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 755.259345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.260377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.260377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.260377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.260377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.288161] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 755.579883] env[65973]: INFO networking_nsxv3.common.synchronization [req-46f7fd7f-687d-4182-84cb-1512b6700c80 req-6be788fb-e942-4fe1-94fe-91b2064f100a tempest-ServerTagsTestJSON-881666583 tempest-ServerTagsTestJSON-881666583-project-member] Enqueued Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 755.581029] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 755.581117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.581413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.581413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.581692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.582030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.582194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.582301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.582578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.582715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.582855] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.087788] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.088175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.088175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.088300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.088424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.088990] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.089170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.089242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.089428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.089511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.089751] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 already deleted. [ 756.089854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.248853] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 756.249517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.279179] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.279380] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-483" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.279497] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-483" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.279900] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-483" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.280225] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.280386] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.280522] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.280708] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.280866] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.281052] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.281161] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.281263] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.281363] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.281463] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.281559] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.281681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.304065] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.304238] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.304692] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.304692] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-483" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.304831] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-629dcafd-ea60-43ac-a256-c4bbec2fbc25 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.305080] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.305266] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.305578] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.305703] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629dcafd-ea60-43ac-a256-c4bbec2fbc25',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.810486] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.811297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.811297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.811535] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.811687] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.811838] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 629dcafd-ea60-43ac-a256-c4bbec2fbc25 not found, creating... [ 756.812115] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.812277] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.812385] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.812624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.812753] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.813170] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.813374] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.813524] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.813859] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.814075] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.814254] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 629dcafd-ea60-43ac-a256-c4bbec2fbc25 is going to be created. [ 756.839904] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.840283] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.840474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.840782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.841066] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.841469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.301783] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 757.302294] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 757.302294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.559608] env[65973]: INFO networking_nsxv3.common.synchronization [req-46f7fd7f-687d-4182-84cb-1512b6700c80 req-989f4351-b21e-4a77-afbc-e2c803b175a1 service nova] Enqueued Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_rules [ 757.559755] env[65973]: INFO networking_nsxv3.common.synchronization [req-46f7fd7f-687d-4182-84cb-1512b6700c80 req-989f4351-b21e-4a77-afbc-e2c803b175a1 service nova] Enqueued Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 757.559882] env[65973]: INFO networking_nsxv3.common.synchronization [req-46f7fd7f-687d-4182-84cb-1512b6700c80 req-989f4351-b21e-4a77-afbc-e2c803b175a1 service nova] Enqueued Resource ID: 629dcafd-ea60-43ac-a256-c4bbec2fbc25 with Priority: HIGHEST for action port [ 757.560430] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_rules [ 757.560566] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 757.560661] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 629dcafd-ea60-43ac-a256-c4bbec2fbc25 with Priority: HIGHEST for action port [ 757.560924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.561138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.564443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.564755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.564899] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.565844] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.566542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.566761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.566980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.567177] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.568032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.568032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.568173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.568275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.568275] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.569191] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-629dcafd-ea60-43ac-a256-c4bbec2fbc25 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.569360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.569471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.569707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.569825] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629dcafd-ea60-43ac-a256-c4bbec2fbc25',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.077502] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.077900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.078603] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.081024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 629dcafd-ea60-43ac-a256-c4bbec2fbc25 with status ACTIVE [ 758.081024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.081024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.081024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.081024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.081024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.081556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.081941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.082772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.082772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.082772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.082772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.082772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.083133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.083133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.083133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.083133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 629dcafd-ea60-43ac-a256-c4bbec2fbc25 is going to be updated. [ 758.109087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.109087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.109087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.109426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.109426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.109518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-629dcafd-ea60-43ac-a256-c4bbec2fbc25" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.586246] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.720510] env[65973]: INFO networking_nsxv3.common.synchronization [req-951243c6-806c-4b35-90b3-798f322067b8 req-94253c51-55d9-4f4b-92d5-a8834deff5e7 tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 758.721429] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 758.722046] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.722222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.722328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.722699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.722937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.723096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.723191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.723415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.723540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.723745] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.886168] env[65973]: INFO networking_nsxv3.common.synchronization [None req-0f17f5d0-5795-42f5-b8fc-e7f9c09d520b None None] Enqueued Resource ID: 9843eb39-da73-40de-87c6-26d4df47cf8a with Priority: HIGHEST for action port [ 758.887120] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9843eb39-da73-40de-87c6-26d4df47cf8a with Priority: HIGHEST for action port [ 758.887120] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9843eb39-da73-40de-87c6-26d4df47cf8a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.887300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9843eb39-da73-40de-87c6-26d4df47cf8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.887300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9843eb39-da73-40de-87c6-26d4df47cf8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.888130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9843eb39-da73-40de-87c6-26d4df47cf8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.888130] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9843eb39-da73-40de-87c6-26d4df47cf8a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.941123] env[65973]: INFO networking_nsxv3.common.synchronization [None req-250d66fb-a3eb-4c90-b030-0c56fe57a44a None None] Enqueued Resource ID: 67f5528c-646d-4bab-9282-e630796ea6fa with Priority: HIGHEST for action port [ 758.941882] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f5528c-646d-4bab-9282-e630796ea6fa with Priority: HIGHEST for action port [ 758.942278] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-67f5528c-646d-4bab-9282-e630796ea6fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.942425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67f5528c-646d-4bab-9282-e630796ea6fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.942518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67f5528c-646d-4bab-9282-e630796ea6fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.942791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67f5528c-646d-4bab-9282-e630796ea6fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.942901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67f5528c-646d-4bab-9282-e630796ea6fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.039767] env[65973]: INFO networking_nsxv3.common.synchronization [req-55901ec7-d8ac-46a7-b647-6b4ed24bef58 req-64ab1790-0914-4ca9-8180-77f4a065c5a5 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 759.040308] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 759.040602] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.040757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.040873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.041689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.042036] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.042163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.042254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.042425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.042516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.042636] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.089684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.089881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.089955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.090231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.090321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.090428] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 is going to be created. [ 759.127958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.128721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.128834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.129716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.130897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142837] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: UNINITIALIZED for 2s [ 759.229512] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.391727] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9843eb39-da73-40de-87c6-26d4df47cf8a [ 759.391727] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.391727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.391727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.391727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.392103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.392103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9843eb39-da73-40de-87c6-26d4df47cf8a already deleted. [ 759.392103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9843eb39-da73-40de-87c6-26d4df47cf8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.444907] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67f5528c-646d-4bab-9282-e630796ea6fa [ 759.445221] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.445343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.445411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.449604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.453143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.455210] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67f5528c-646d-4bab-9282-e630796ea6fa already deleted. [ 759.455210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67f5528c-646d-4bab-9282-e630796ea6fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.545121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.545284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.545345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.545576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.545768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.546202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.546202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.546202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.546202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.546427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.546427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 759.595297] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.596100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.598136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.598136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.598136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.600777] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.601399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.601622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.601954] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.602326] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.602607] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.602812] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.603119] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.603468] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.603773] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.603973] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.604193] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.604408] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.606548] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.606548] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.606548] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.612980] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 759.632061] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.632061] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.632061] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.632061] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.632301] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-bde9cb6c-50ab-4e38-a140-898e3192fe94 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.632407] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.632893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.632893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.633056] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde9cb6c-50ab-4e38-a140-898e3192fe94',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.732631] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.135576] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.136537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.136537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.136537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.136537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.136747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port bde9cb6c-50ab-4e38-a140-898e3192fe94 not found, creating... [ 760.136854] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.137475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.137638] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.137892] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.138043] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.138350] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.138531] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.138719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.139046] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.139199] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.139352] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: bde9cb6c-50ab-4e38-a140-898e3192fe94 is going to be created. [ 760.168394] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.168651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.168715] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.168955] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.169335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.169544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.237833] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.237833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.237833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.237833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.237833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.237833] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 760.284938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.286252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.286252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.286252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.286252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.297243] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 760.916505] env[65973]: INFO networking_nsxv3.common.synchronization [req-55901ec7-d8ac-46a7-b647-6b4ed24bef58 req-d6feb1e4-8669-4c2e-8f54-2c1b88a6005a service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 760.916505] env[65973]: INFO networking_nsxv3.common.synchronization [req-55901ec7-d8ac-46a7-b647-6b4ed24bef58 req-d6feb1e4-8669-4c2e-8f54-2c1b88a6005a service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 760.916505] env[65973]: INFO networking_nsxv3.common.synchronization [req-55901ec7-d8ac-46a7-b647-6b4ed24bef58 req-d6feb1e4-8669-4c2e-8f54-2c1b88a6005a service nova] Enqueued Resource ID: bde9cb6c-50ab-4e38-a140-898e3192fe94 with Priority: HIGHEST for action port [ 760.917333] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 760.917333] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 760.917426] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde9cb6c-50ab-4e38-a140-898e3192fe94 with Priority: HIGHEST for action port [ 760.917732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.917826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.917879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.918106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.918277] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.926126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.926126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.926126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bde9cb6c-50ab-4e38-a140-898e3192fe94 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.926126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.926126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.926126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.926126] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde9cb6c-50ab-4e38-a140-898e3192fe94',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.155782] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: SUCCESS [ 761.156059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.156200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.156426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.156918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.156918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.156918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.158541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.158541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.158541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.158541] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.239671] env[65973]: INFO networking_nsxv3.common.synchronization [None req-3a270f5e-0a9a-4ef7-8ce5-cba2f662f2b5 None None] Enqueued Resource ID: d78b8983-713b-4313-972c-1de0bab91f8b with Priority: HIGHEST for action port [ 761.240212] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78b8983-713b-4313-972c-1de0bab91f8b with Priority: HIGHEST for action port [ 761.243147] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78b8983-713b-4313-972c-1de0bab91f8b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.243147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78b8983-713b-4313-972c-1de0bab91f8b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.243147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78b8983-713b-4313-972c-1de0bab91f8b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.243147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78b8983-713b-4313-972c-1de0bab91f8b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.243147] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78b8983-713b-4313-972c-1de0bab91f8b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.430022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.430022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.430022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bde9cb6c-50ab-4e38-a140-898e3192fe94 with status ACTIVE [ 761.430022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.430022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.430022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.430341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.430341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.430485] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.430607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.430689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.430898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.432674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.432674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.432674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.432674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.432674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.432674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.432674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bde9cb6c-50ab-4e38-a140-898e3192fe94 is going to be updated. [ 761.460895] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.460895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.460895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.461204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.461204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.461340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bde9cb6c-50ab-4e38-a140-898e3192fe94" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.624269] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 761.624269] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.624269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.624269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.624647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.626792] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.632613] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5d2887ce-e97e-48d8-8466-0f26e1cd424b None None] Enqueued Resource ID: e6f3b92e-f007-473b-8e8e-2125177dcdd4 with Priority: HIGHEST for action port [ 761.633034] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6f3b92e-f007-473b-8e8e-2125177dcdd4 with Priority: HIGHEST for action port [ 761.637023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6f3b92e-f007-473b-8e8e-2125177dcdd4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.637023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6f3b92e-f007-473b-8e8e-2125177dcdd4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.637023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6f3b92e-f007-473b-8e8e-2125177dcdd4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.637023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6f3b92e-f007-473b-8e8e-2125177dcdd4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.637023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f3b92e-f007-473b-8e8e-2125177dcdd4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.661671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.661671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.661671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.661671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.661974] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.661974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.661974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.662100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.662150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.662232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.662423] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.662472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.662526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.662860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.662860] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.664358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.664358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.664475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.664595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.664779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.664881] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.749082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d78b8983-713b-4313-972c-1de0bab91f8b [ 761.749082] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.749082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.749082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.749082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.749082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.749082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d78b8983-713b-4313-972c-1de0bab91f8b already deleted. [ 761.749082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78b8983-713b-4313-972c-1de0bab91f8b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.133447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.138504] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6f3b92e-f007-473b-8e8e-2125177dcdd4 [ 762.138504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.138504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.138504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.138671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.138671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.138743] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6f3b92e-f007-473b-8e8e-2125177dcdd4 already deleted. [ 762.138891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6f3b92e-f007-473b-8e8e-2125177dcdd4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.168799] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2: rpc.has_security_group_logging(os_id): False [ 762.186999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.187156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.187223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.187435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.187527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.187735] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.187836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.188241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.188241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.188241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.188376] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.188425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.188454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.189052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.189052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.189052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.189052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.189052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.189535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.189623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.189715] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 is going to be created. [ 762.253892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.255106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.255310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.255748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.256045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.279392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: IN_PROGRESS for 2s [ 762.309826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 762.309826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.641026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.766359] env[65973]: INFO networking_nsxv3.common.synchronization [None req-57767756-953d-4300-bd61-670d03d6a8c9 None None] Enqueued Resource ID: d8b729f6-f25a-4843-be06-379e64bd50e8 with Priority: HIGHEST for action port [ 762.767279] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8b729f6-f25a-4843-be06-379e64bd50e8 with Priority: HIGHEST for action port [ 762.768433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8b729f6-f25a-4843-be06-379e64bd50e8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.768433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8b729f6-f25a-4843-be06-379e64bd50e8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.768433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8b729f6-f25a-4843-be06-379e64bd50e8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.770259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8b729f6-f25a-4843-be06-379e64bd50e8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.770397] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b729f6-f25a-4843-be06-379e64bd50e8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.146679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.146679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.146679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.146679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.146679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.146679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 763.196335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.196335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.196335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.196335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.196335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.207046] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 763.273047] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8b729f6-f25a-4843-be06-379e64bd50e8 [ 763.273266] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.273433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.273522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.273837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.273904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.274038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8b729f6-f25a-4843-be06-379e64bd50e8 already deleted. [ 763.274100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8b729f6-f25a-4843-be06-379e64bd50e8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.294745] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: SUCCESS [ 764.295048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.220822] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 765.221063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.221246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.221476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.221671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.221791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.221858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.222029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.222116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.222202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.222295] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.398610] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e73b8e17-4d8b-43fe-a0b1-c33e2cec5513 None None] Enqueued Resource ID: 9513daac-a6f3-428a-8320-a8224de268d5 with Priority: HIGHEST for action port [ 765.399954] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9513daac-a6f3-428a-8320-a8224de268d5 with Priority: HIGHEST for action port [ 765.400347] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9513daac-a6f3-428a-8320-a8224de268d5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.400941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9513daac-a6f3-428a-8320-a8224de268d5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.400941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9513daac-a6f3-428a-8320-a8224de268d5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.401165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9513daac-a6f3-428a-8320-a8224de268d5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.401604] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9513daac-a6f3-428a-8320-a8224de268d5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.728365] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.728696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.728696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730683] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.730683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.730683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730683] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.907441] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9513daac-a6f3-428a-8320-a8224de268d5 [ 765.908038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.908155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.908197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.908451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.908574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.908686] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9513daac-a6f3-428a-8320-a8224de268d5 already deleted. [ 765.909261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9513daac-a6f3-428a-8320-a8224de268d5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.234182] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab67debe-f546-499b-8301-c37179fecdee: rpc.has_security_group_logging(os_id): False [ 766.264954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.265120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.265284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.265550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.265647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.265870] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.265982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.266104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.266252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.266334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.266513] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.266623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.266687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.266829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.266903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.268252] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.270510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.270510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.270510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.270510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.270510] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 766.353642] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.353976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.353976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.354488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.354576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.375928] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 767.478590] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.479859] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.779072] env[65973]: INFO networking_nsxv3.common.synchronization [req-a1765307-e87c-4fc6-8ede-7142a53e981d req-5c4459e1-55c9-4d4b-afcb-f8ae9d047d4a tempest-FloatingIPsAssociationTestJSON-1939154346 tempest-FloatingIPsAssociationTestJSON-1939154346-project-member] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 767.779589] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGHEST for action security_group_members [ 767.779946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.780141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.780230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.780811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.780811] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.780811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.781055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.781055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.781152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.781189] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.241985] env[65973]: INFO networking_nsxv3.common.synchronization [req-6928cba3-a070-4cd7-826c-fd994e15b5d5 req-d78d039e-3eb8-4ba5-bc88-4f106b48b568 tempest-ServerMetadataNegativeTestJSON-1670431293 tempest-ServerMetadataNegativeTestJSON-1670431293-project-member] Enqueued Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 768.242683] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGHEST for action security_group_members [ 768.243149] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.243268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.243351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.243639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.244658] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.244658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.244658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.244658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.244658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.244658] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.283859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.284040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.284081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.284687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.284687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.284687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.284687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.284888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.284888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.284945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.285115] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be updated. [ 768.314289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.314914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.314914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.314914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.315094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.325386] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: IN_PROGRESS for 2s [ 768.390379] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 768.390643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.747261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.747542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.747542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.747696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.747790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.748073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.748207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.748275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.748439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.748518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.748633] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 is going to be updated. [ 768.795059] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.795059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.795943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.796200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.796414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.808913] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: IN_PROGRESS for 2s [ 769.459813] env[65973]: INFO networking_nsxv3.common.synchronization [req-ec555f42-ee3f-4526-9d2e-b464ab5bf3c9 req-04f85590-bc7e-4b49-801e-4f451568c27c tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 769.460385] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 769.460691] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.460811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.460909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.461360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.461509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.461651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.461742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.461950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.462096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.462239] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.782414] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.782809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.782915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.783262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.783645] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.785694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.785694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.785694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.785694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.785694] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.785694] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.785694] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.785694] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.785694] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.785694] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.785694] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.811182] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.811491] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.811701] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.811938] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.812319] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-d766267c-2d61-4e73-97fa-4307fa4cfd63 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.812545] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.812666] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.813302] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.813770] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d766267c-2d61-4e73-97fa-4307fa4cfd63',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.964728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.964907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.964972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.965322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.965432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.965614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.965751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.965820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.965946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.966032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.966118] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c already deleted. [ 769.966220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.316152] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.316496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.316849] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.317083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.317679] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.317679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port d766267c-2d61-4e73-97fa-4307fa4cfd63 not found, creating... [ 770.317991] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.318226] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.318337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.318654] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.318914] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.319364] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.319600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.319773] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.320123] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.320318] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.320553] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: d766267c-2d61-4e73-97fa-4307fa4cfd63 is going to be created. [ 770.341480] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 in Status: SUCCESS [ 770.342019] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 deletion is rescheduled due to dependency. [ 770.342019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.353444] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.353728] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.353803] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.354154] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.354400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.354626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.823535] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ee6965-6080-4005-80bf-0264af4bd437 in Status: SUCCESS [ 770.824012] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 deletion is rescheduled due to dependency. [ 770.824012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.977193] env[65973]: INFO networking_nsxv3.common.synchronization [req-3d9f8ecc-4188-48f3-8de8-b6ab3588bcd8 req-a5d41a0c-fbbc-4bf7-b6c9-791315331185 tempest-ListImageFiltersTestJSON-302671947 tempest-ListImageFiltersTestJSON-302671947-project-member] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 770.977354] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 770.977795] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.978684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.978954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.979385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.979629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.979855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.979855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.980123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.980257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.980400] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.114115] env[65973]: INFO networking_nsxv3.common.synchronization [req-ec555f42-ee3f-4526-9d2e-b464ab5bf3c9 req-70274aea-6132-4b74-b2da-6aa109dba1ae service nova] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_rules [ 771.114115] env[65973]: INFO networking_nsxv3.common.synchronization [req-ec555f42-ee3f-4526-9d2e-b464ab5bf3c9 req-70274aea-6132-4b74-b2da-6aa109dba1ae service nova] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 771.114115] env[65973]: INFO networking_nsxv3.common.synchronization [req-ec555f42-ee3f-4526-9d2e-b464ab5bf3c9 req-70274aea-6132-4b74-b2da-6aa109dba1ae service nova] Enqueued Resource ID: d766267c-2d61-4e73-97fa-4307fa4cfd63 with Priority: HIGHEST for action port [ 771.117931] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_rules [ 771.117978] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 771.121043] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d766267c-2d61-4e73-97fa-4307fa4cfd63 with Priority: HIGHEST for action port [ 771.121043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.121043] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.121043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.121043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.121043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.121738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.121738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.121738] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.122743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d766267c-2d61-4e73-97fa-4307fa4cfd63 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.122743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.122743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.122743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.122743] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d766267c-2d61-4e73-97fa-4307fa4cfd63',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.464259] env[65973]: INFO networking_nsxv3.common.synchronization [req-10176b12-a764-4146-81c6-eee13790845e req-c1204b41-273c-4121-ab39-55b5e1c3cad8 tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 771.465491] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 771.465812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.465930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.465996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466385] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466872] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.483292] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.624181] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.625296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.625459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.625843] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d766267c-2d61-4e73-97fa-4307fa4cfd63 with status ACTIVE [ 771.626131] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.626245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.626245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.626410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.626513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.626680] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.626770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.626827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.627173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.627358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.627588] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.627686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.627755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.627894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.627967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.628080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d766267c-2d61-4e73-97fa-4307fa4cfd63 is going to be updated. [ 771.653321] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.653501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.653582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.653777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.653920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.654108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d766267c-2d61-4e73-97fa-4307fa4cfd63" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.969765] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.989522] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.127927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.474750] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.494820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.494820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.494820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.494820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.494820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.494820] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be updated. [ 772.525918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.526103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.526178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.526412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.526619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.539780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 772.629686] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.629847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.629922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.631042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.631042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.631042] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be created. [ 772.654610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.654739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.654804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.655030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.655200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.666953] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: UNINITIALIZED for 2s [ 772.976804] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.977140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.977140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.977233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.977342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.977444] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 773.010649] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.010786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.010857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.011076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.011224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.023119] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 774.333065] env[65973]: INFO networking_nsxv3.common.synchronization [None req-6168c929-0c64-4b73-903a-47981556673a None None] Enqueued Resource ID: abd52352-ff29-4f7d-b057-543581838add with Priority: HIGHEST for action port [ 774.333788] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd52352-ff29-4f7d-b057-543581838add with Priority: HIGHEST for action port [ 774.334019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd52352-ff29-4f7d-b057-543581838add taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.334485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd52352-ff29-4f7d-b057-543581838add" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.334485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd52352-ff29-4f7d-b057-543581838add" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.334583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd52352-ff29-4f7d-b057-543581838add" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.334623] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd52352-ff29-4f7d-b057-543581838add',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.551861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 774.552123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.678313] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: UNINITIALIZED for 4s [ 774.839699] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abd52352-ff29-4f7d-b057-543581838add [ 774.839699] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.839699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.840091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.840091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.840091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.840204] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abd52352-ff29-4f7d-b057-543581838add already deleted. [ 774.840265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd52352-ff29-4f7d-b057-543581838add" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.040025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 775.040025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.436195] env[65973]: INFO networking_nsxv3.common.synchronization [req-ad5c5022-7ba7-468d-a10d-4d82d8a02fcb req-385392e2-8730-4b70-962c-8c90137a1ea5 tempest-ServersAdminNegativeTestJSON-821105226 tempest-ServersAdminNegativeTestJSON-821105226-project-member] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 775.436767] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGHEST for action security_group_members [ 775.437270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.437374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.437431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.442403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.442403] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.442403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.442403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.442403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.442403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.442403] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.944937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.945165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.945275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.945459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.945555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.945784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.945881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.945941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.946129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.946190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.946277] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be updated. [ 775.995351] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.995570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.995636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.995843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.995979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.008409] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: IN_PROGRESS for 2s [ 776.065563] env[65973]: INFO networking_nsxv3.common.synchronization [req-bad758d2-7492-4863-a995-393c50d0fc76 req-99ebb8e8-2e64-4743-9103-b5f7b0303d1f tempest-ServerMetadataTestJSON-546650741 tempest-ServerMetadataTestJSON-546650741-project-member] Enqueued Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 776.066498] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGHEST for action security_group_members [ 776.067290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.067290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.067290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.067515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.067640] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.067726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.069183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.069426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.069519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.069634] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.574021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.574021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.574021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.574021] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 is going to be updated. [ 776.604849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.604849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.604849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.605088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.605088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.614747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: IN_PROGRESS for 2s [ 776.688307] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.691033] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.691033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.691033] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.752871] env[65973]: INFO networking_nsxv3.common.synchronization [None req-29b9db46-a2ac-4c4f-a0e0-79ef2c369f80 None None] Enqueued Resource ID: 5ee7460a-15d3-4782-8f77-d5ceee6177ab with Priority: HIGHEST for action port [ 776.752871] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee7460a-15d3-4782-8f77-d5ceee6177ab with Priority: HIGHEST for action port [ 776.753214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ee7460a-15d3-4782-8f77-d5ceee6177ab taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.753319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ee7460a-15d3-4782-8f77-d5ceee6177ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.753371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ee7460a-15d3-4782-8f77-d5ceee6177ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.753645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ee7460a-15d3-4782-8f77-d5ceee6177ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.753731] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee7460a-15d3-4782-8f77-d5ceee6177ab',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.196160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.196160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.196160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.196160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.196160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.196753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.196753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.196753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.196753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.196753] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.255513] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ee7460a-15d3-4782-8f77-d5ceee6177ab [ 777.255752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.255889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.255951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.256357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.256357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.256474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ee7460a-15d3-4782-8f77-d5ceee6177ab already deleted. [ 777.256474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ee7460a-15d3-4782-8f77-d5ceee6177ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.698833] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c: rpc.has_security_group_logging(os_id): False [ 777.722134] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722134] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722134] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.722134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.722725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.722725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.722725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.722725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be created. [ 777.828067] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.828067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.828067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.828067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.828067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.848213] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 778.024468] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 in Status: SUCCESS [ 778.024646] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 deletion is rescheduled due to dependency. [ 778.024792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.626726] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 in Status: SUCCESS [ 778.626726] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 deletion is rescheduled due to dependency. [ 778.626726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.862394] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 779.862394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.991307] env[65973]: INFO networking_nsxv3.common.synchronization [req-595bc389-b6b8-4c7a-9a50-ea4ecebe710c req-8195bf9c-994b-4647-b839-e5a64631197e tempest-ServerTagsTestJSON-881666583 tempest-ServerTagsTestJSON-881666583-project-member] Enqueued Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 780.993998] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGHEST for action security_group_members [ 780.994291] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.994582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.994582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.995031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.995271] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.995387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.995446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.995630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.995818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.996088] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.499603] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.499603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.499908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.500341] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.500496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.500572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.500834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.501067] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 is going to be updated. [ 781.540048] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.541328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.541475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.541807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.542059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.555952] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: IN_PROGRESS for 2s [ 782.204191] env[65973]: INFO networking_nsxv3.common.synchronization [req-78dd0907-51a1-453f-bf06-43669bdfcfcf req-812133d5-67c6-4095-afbd-8268684116ac tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 782.206799] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 782.206799] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.206799] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.206799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.207752] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.368772] env[65973]: INFO networking_nsxv3.common.synchronization [None req-926a3fc6-90ba-4ecc-a2ce-d81de007df56 None None] Enqueued Resource ID: d7d43015-4e33-4501-a3f4-c42c21476933 with Priority: HIGHEST for action port [ 782.370069] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d43015-4e33-4501-a3f4-c42c21476933 with Priority: HIGHEST for action port [ 782.371054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d43015-4e33-4501-a3f4-c42c21476933 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.371054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d43015-4e33-4501-a3f4-c42c21476933" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.371054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d43015-4e33-4501-a3f4-c42c21476933" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.373323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d43015-4e33-4501-a3f4-c42c21476933" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.373323] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d43015-4e33-4501-a3f4-c42c21476933',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.711897] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.711897] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.711897] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db already deleted. [ 782.711897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.729444] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.729444] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.729444] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.729805] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.730075] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.730232] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.730366] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.730596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.730782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.730988] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.731108] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.731209] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.731310] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.731410] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.731522] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.731656] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.762306] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.762556] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.762743] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.763021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.763567] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.763832] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.764250] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.764688] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.764881] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8677e7ff-de2b-474c-97a7-ba4a3d2947d3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.876095] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7d43015-4e33-4501-a3f4-c42c21476933 [ 782.876095] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.876207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.876248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.876845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.876845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.876845] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7d43015-4e33-4501-a3f4-c42c21476933 already deleted. [ 782.876845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d43015-4e33-4501-a3f4-c42c21476933" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.267702] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.268218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.268218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.268515] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.268668] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.268868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 not found, creating... [ 783.269233] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.269473] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.269625] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.270420] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.270420] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.270420] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.270600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.270701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.270937] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.271915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.271915] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 is going to be created. [ 783.294528] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.294771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.294771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.295084] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.295260] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.295572] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.568105] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 in Status: SUCCESS [ 783.568255] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 deletion is rescheduled due to dependency. [ 783.568311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.072790] env[65973]: INFO networking_nsxv3.common.synchronization [req-78dd0907-51a1-453f-bf06-43669bdfcfcf req-c70b1e1a-b209-4bf1-a66a-4c46ebe02edb service nova] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 784.072895] env[65973]: INFO networking_nsxv3.common.synchronization [req-78dd0907-51a1-453f-bf06-43669bdfcfcf req-c70b1e1a-b209-4bf1-a66a-4c46ebe02edb service nova] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 784.073040] env[65973]: INFO networking_nsxv3.common.synchronization [req-78dd0907-51a1-453f-bf06-43669bdfcfcf req-c70b1e1a-b209-4bf1-a66a-4c46ebe02edb service nova] Enqueued Resource ID: 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 with Priority: HIGHEST for action port [ 784.075473] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_rules [ 784.075628] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 784.075718] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 with Priority: HIGHEST for action port [ 784.076000] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.076153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.076224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.076444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.076554] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.077544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.077636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.077688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.077808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.077950] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.078317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.078317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.078317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.080672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.080810] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.081874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.081992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.082138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.082252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.082360] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8677e7ff-de2b-474c-97a7-ba4a3d2947d3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.584761] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.586224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.586224] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.587478] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 with status ACTIVE [ 784.587918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.588268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.590025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.590025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.591805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.594028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.594028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.594028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.594028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.594028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8677e7ff-de2b-474c-97a7-ba4a3d2947d3 is going to be updated. [ 784.622045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.622045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.622045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.622045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.622045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.622045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8677e7ff-de2b-474c-97a7-ba4a3d2947d3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.751145] env[65973]: INFO networking_nsxv3.common.synchronization [req-ecae7e1c-468d-4b7d-b2d4-0514e140fd92 req-f72076b0-3025-443f-b93d-fdc105bd0ab6 tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 784.751145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 784.751145] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.751145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.751145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.752387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.752679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.752915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.753083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.753634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.754210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.754458] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.894136] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8dd42836-1322-4351-b421-a88e4c9c2005 None None] Enqueued Resource ID: aafc47e7-0ce8-4ff7-a036-595d4b3b3b33 with Priority: HIGHEST for action port [ 784.894756] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafc47e7-0ce8-4ff7-a036-595d4b3b3b33 with Priority: HIGHEST for action port [ 784.895120] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-aafc47e7-0ce8-4ff7-a036-595d4b3b3b33 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.895246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aafc47e7-0ce8-4ff7-a036-595d4b3b3b33" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.895316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aafc47e7-0ce8-4ff7-a036-595d4b3b3b33" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.895605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aafc47e7-0ce8-4ff7-a036-595d4b3b3b33" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.895798] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aafc47e7-0ce8-4ff7-a036-595d4b3b3b33',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.097481] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.257285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.257450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.257545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.257842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.257960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.258229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.258361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.258426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.258603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.258702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.258792] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 785.298085] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.298311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.298389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.298640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.298744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.309462] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 785.398088] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aafc47e7-0ce8-4ff7-a036-595d4b3b3b33 [ 785.398387] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.398626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.398626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.398858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.398936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.399075] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aafc47e7-0ce8-4ff7-a036-595d4b3b3b33 already deleted. [ 785.399150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aafc47e7-0ce8-4ff7-a036-595d4b3b3b33" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.606824] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.607190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.607190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.607392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.607505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.607612] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db is going to be created. [ 785.635625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.635795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.635855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.636113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.636293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.650683] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: UNINITIALIZED for 2s [ 785.673212] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.673406] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.673566] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.673806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.674013] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.674162] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.674270] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.674469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.674611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.674790] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.674892] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.675020] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.675098] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.675197] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.675296] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.675415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.695271] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.695998] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.695998] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.695998] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.696314] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-34724e91-6c95-461a-bb77-fcb3f8571895 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.696485] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.696624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.697098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.697250] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34724e91-6c95-461a-bb77-fcb3f8571895',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.976289] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e9beac56-f518-4523-a3a2-6d4432408899 None None] Enqueued Resource ID: 111afef9-c6c2-4f9b-88ba-a3407eb1baa9 with Priority: HIGHEST for action port [ 785.976289] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 111afef9-c6c2-4f9b-88ba-a3407eb1baa9 with Priority: HIGHEST for action port [ 785.976289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-111afef9-c6c2-4f9b-88ba-a3407eb1baa9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.976289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-111afef9-c6c2-4f9b-88ba-a3407eb1baa9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.976289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-111afef9-c6c2-4f9b-88ba-a3407eb1baa9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.976289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-111afef9-c6c2-4f9b-88ba-a3407eb1baa9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.976289] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('111afef9-c6c2-4f9b-88ba-a3407eb1baa9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.200169] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200509] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.201022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.201266] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.201559] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 34724e91-6c95-461a-bb77-fcb3f8571895 not found, creating... [ 786.201996] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.202261] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.202460] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.202917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.203248] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.203606] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.203778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.203888] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.204158] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.204335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.204481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 34724e91-6c95-461a-bb77-fcb3f8571895 is going to be created. [ 786.232831] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.232831] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.232831] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.232831] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.232831] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.233521] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.479265] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 111afef9-c6c2-4f9b-88ba-a3407eb1baa9 [ 786.479265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.479457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.479457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.479570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.479694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.479740] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:111afef9-c6c2-4f9b-88ba-a3407eb1baa9 already deleted. [ 786.479850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-111afef9-c6c2-4f9b-88ba-a3407eb1baa9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.009312] env[65973]: INFO networking_nsxv3.common.synchronization [req-ecae7e1c-468d-4b7d-b2d4-0514e140fd92 req-e1b3f323-2f8b-4fe0-af99-7027e2f49216 service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 787.009847] env[65973]: INFO networking_nsxv3.common.synchronization [req-ecae7e1c-468d-4b7d-b2d4-0514e140fd92 req-e1b3f323-2f8b-4fe0-af99-7027e2f49216 service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 787.010110] env[65973]: INFO networking_nsxv3.common.synchronization [req-ecae7e1c-468d-4b7d-b2d4-0514e140fd92 req-e1b3f323-2f8b-4fe0-af99-7027e2f49216 service nova] Enqueued Resource ID: 34724e91-6c95-461a-bb77-fcb3f8571895 with Priority: HIGHEST for action port [ 787.010917] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 787.012050] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 787.012050] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34724e91-6c95-461a-bb77-fcb3f8571895 with Priority: HIGHEST for action port [ 787.012050] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.012050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.012050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.012050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.012310] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.014032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.014032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.014032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-34724e91-6c95-461a-bb77-fcb3f8571895 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.014032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.014032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.014281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.014509] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34724e91-6c95-461a-bb77-fcb3f8571895',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.323143] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 787.323143] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e deletion is rescheduled due to dependency. [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.323143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.323143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.323143] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.456449] env[65973]: INFO networking_nsxv3.common.synchronization [req-ad595eda-0a4c-4e4b-83d6-09eeec2b6dd6 req-f3e4497d-aabe-4ed8-9eaf-a3f77f23f597 tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 787.456798] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 787.457054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.457227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.457332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.457573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.457771] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.457919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.458044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.458252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.458430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.458655] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.516639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.516784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.519121] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34724e91-6c95-461a-bb77-fcb3f8571895 with status ACTIVE [ 787.519390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.520859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.520859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.520859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.521504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.521504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.521504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.521504] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34724e91-6c95-461a-bb77-fcb3f8571895 is going to be updated. [ 787.546135] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.546449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.546449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.546751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.546914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.547132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34724e91-6c95-461a-bb77-fcb3f8571895" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.663586] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: UNINITIALIZED for 4s [ 787.829061] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.869582] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.869964] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.870700] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.871095] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.871579] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.871579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.871852] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.872614] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.872614] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.872614] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.873207] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.873613] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.876028] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.876028] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.876028] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.876028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.897606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.897606] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 787.897606] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.897606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-105" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.897606] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-db383d6c-289f-47e7-a5cb-60c928d834f0 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.897606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.897606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.897606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.897606] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db383d6c-289f-47e7-a5cb-60c928d834f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.962203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.962420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.962509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.962738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.962827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.963213] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.963327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.963721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.964476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.964476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.964476] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 787.989874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.990086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.990086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.990310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.990483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.005172] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 788.332232] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.403998] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.404328] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.405295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.406369] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.406369] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.406369] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port db383d6c-289f-47e7-a5cb-60c928d834f0 not found, creating... [ 788.406369] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.406546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.406642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.406819] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.406931] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.407453] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.407575] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.407621] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.407837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.407978] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.408196] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: db383d6c-289f-47e7-a5cb-60c928d834f0 is going to be created. [ 788.430114] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.430429] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.430566] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.430850] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.431100] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.431368] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.613023] env[65973]: INFO networking_nsxv3.common.synchronization [None req-4f034ef6-7f39-41d3-9e33-737aca587ee8 None None] Enqueued Resource ID: cbba6697-3e09-4189-8d6b-6a26b8619f53 with Priority: HIGHEST for action port [ 788.613023] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbba6697-3e09-4189-8d6b-6a26b8619f53 with Priority: HIGHEST for action port [ 788.613023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbba6697-3e09-4189-8d6b-6a26b8619f53 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.613023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbba6697-3e09-4189-8d6b-6a26b8619f53" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.613023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbba6697-3e09-4189-8d6b-6a26b8619f53" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.613798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbba6697-3e09-4189-8d6b-6a26b8619f53" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.613962] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbba6697-3e09-4189-8d6b-6a26b8619f53',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.837000] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.837000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.837000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.837000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.837000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.837000] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 788.871038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.871038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.871038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.871038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.871038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.881191] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 789.118705] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbba6697-3e09-4189-8d6b-6a26b8619f53 [ 789.118945] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.119100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.119160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.119443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.119540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.119672] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbba6697-3e09-4189-8d6b-6a26b8619f53 already deleted. [ 789.119737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbba6697-3e09-4189-8d6b-6a26b8619f53" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.206267] env[65973]: INFO networking_nsxv3.common.synchronization [req-ad595eda-0a4c-4e4b-83d6-09eeec2b6dd6 req-95984c67-d70d-4e0a-a791-86512e8fd459 service nova] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 789.206917] env[65973]: INFO networking_nsxv3.common.synchronization [req-ad595eda-0a4c-4e4b-83d6-09eeec2b6dd6 req-95984c67-d70d-4e0a-a791-86512e8fd459 service nova] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 789.206917] env[65973]: INFO networking_nsxv3.common.synchronization [req-ad595eda-0a4c-4e4b-83d6-09eeec2b6dd6 req-95984c67-d70d-4e0a-a791-86512e8fd459 service nova] Enqueued Resource ID: db383d6c-289f-47e7-a5cb-60c928d834f0 with Priority: HIGHEST for action port [ 789.207876] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_rules [ 789.208196] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 789.208412] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db383d6c-289f-47e7-a5cb-60c928d834f0 with Priority: HIGHEST for action port [ 789.208910] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.209181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.209360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.209676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.209859] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.213508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.213508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.213508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-db383d6c-289f-47e7-a5cb-60c928d834f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.213508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.213508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.213911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.213911] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db383d6c-289f-47e7-a5cb-60c928d834f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.676290] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: SUCCESS [ 789.676723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.676723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.677215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.677215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.677606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.677606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.677764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.677764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.677851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.677982] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.716978] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db383d6c-289f-47e7-a5cb-60c928d834f0 with status ACTIVE [ 789.717261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.717437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.717487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.717707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.717814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.717976] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.718084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.718138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.718468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.718615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.718920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.719095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.719172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.719411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.719522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.719657] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db383d6c-289f-47e7-a5cb-60c928d834f0 is going to be updated. [ 789.721360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.721493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.744880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.745062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.745142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.745327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.745526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.745670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db383d6c-289f-47e7-a5cb-60c928d834f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.016797] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 790.016889] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c deletion is rescheduled due to dependency. [ 790.017014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.017256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.017481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.017685] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.017802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.017869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.018044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.018127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.018243] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.180507] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.521044] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.682771] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf3c541-0add-4e54-89d3-ee7e90d5c0db: rpc.has_security_group_logging(os_id): False [ 790.706154] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.706389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.706474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.706674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.706815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.707127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.707607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.707607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.707729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.707729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.707815] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db is going to be created. [ 790.792718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.792895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.792958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.793238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.793435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.808800] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: IN_PROGRESS for 2s [ 790.913474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 790.913815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.914023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.914305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.914528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.914707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.914784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.915043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.915169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.915263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.915403] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.023609] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.422622] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.423406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.423406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.423406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.423681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.423797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.423862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.424055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.424172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.424362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.424528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.424625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.424700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.424899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.425017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.425116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.425239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.425353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.425429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.425856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.425856] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.526351] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.527259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.527259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.527259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.527490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.527674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 791.589467] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.589855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.589855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.589970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.590080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.601570] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 791.932650] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12bf28a0-51ca-4171-b63e-ba9ad7a0139e: rpc.has_security_group_logging(os_id): False [ 791.952565] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.952709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.954678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.954678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.954678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.955353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.955353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.955523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.955635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.955715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.955802] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 792.031657] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.031852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.031916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.032129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.032279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.047077] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 792.559512] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-e5302d85-08cb-42db-8efb-ce57bf59fc39 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 792.560618] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 792.560618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.560618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.561268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.561268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.562169] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.563379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.563379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.563379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.563379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.563379] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.804027] env[65973]: INFO networking_nsxv3.common.synchronization [req-4812e356-56f9-487f-9fd0-0809a233eaa6 req-7b972090-2e99-4ee6-9ca0-302fd546bf43 tempest-ServersTestFqdnHostnames-1718908810 tempest-ServersTestFqdnHostnames-1718908810-project-member] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 792.804815] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGHEST for action security_group_members [ 792.805478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.805677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.805748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.806061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.806321] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.806465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.806583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.806796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.806934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.807094] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.827218] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: SUCCESS [ 792.827474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.972130] env[65973]: INFO networking_nsxv3.common.synchronization [req-080e2da8-4413-40c4-9971-d631ba83c80a req-e382ae69-54a3-4e65-8073-87aadc9d02c8 tempest-ServersTestManualDisk-443173538 tempest-ServersTestManualDisk-443173538-project-member] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 792.972844] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGHEST for action security_group_members [ 792.973209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.973356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.973424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.973619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.973789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.973909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.974188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.974188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.974188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.974653] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.069203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.069203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.069203] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e already deleted. [ 793.069203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.310152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.310392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.310450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.310677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.310773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.310972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.311096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.311157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.311318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.311431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.311496] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f is going to be updated. [ 793.342811] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.343044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.343044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.343301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.343459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.352393] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: IN_PROGRESS for 2s [ 793.411029] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.411029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.411029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.411698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.412237] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.415024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.415024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.415024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.415024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.415024] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.415024] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.415024] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.415024] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.415024] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.415024] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.415024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.425184] env[65973]: INFO networking_nsxv3.common.synchronization [req-3c095bb2-d1b2-4e6c-a3a6-309c60b49ad3 req-121d91ac-e0ea-468c-a6c9-110f6b7e1678 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 793.428682] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 793.428682] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428682] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.428682] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.437325] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.438207] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.438539] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.438842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.439511] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.442376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.442376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.442376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.442376] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6f8b51d-04ae-46ad-9d71-e040e8098fd2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.479084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.479279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.479353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.479584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.479680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.479903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.480269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.480269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.480269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.480439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.480439] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84af9696-6508-477b-a988-cda90bb86706 is going to be updated. [ 793.530269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.530269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.530269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.530269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.530269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.542558] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: IN_PROGRESS for 2s [ 793.612926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 793.612926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.612926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.612926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.613096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.613223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.613363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.613539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.613625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.613711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.613802] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.931042] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.947455] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.947455] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.947455] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.948686] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.948686] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.948859] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port d6f8b51d-04ae-46ad-9d71-e040e8098fd2 not found, creating... [ 793.949131] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.949351] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.949479] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.949767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.950586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.950586] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.950586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.950586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.950938] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.951467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.951657] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: d6f8b51d-04ae-46ad-9d71-e040e8098fd2 is going to be created. [ 793.974314] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.974717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.975549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.975549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.975549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.975549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.066157] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 794.066395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.119123] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.433440] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.622736] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c: rpc.has_security_group_logging(os_id): False [ 794.645484] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.645795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.645957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.646239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.646377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.647452] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.647452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.647452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.647452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.647452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.647452] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 794.731853] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-5013dc83-2410-4278-8bfd-b3bdd4a06685 service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 794.733311] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-5013dc83-2410-4278-8bfd-b3bdd4a06685 service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 794.734167] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-5013dc83-2410-4278-8bfd-b3bdd4a06685 service nova] Enqueued Resource ID: d6f8b51d-04ae-46ad-9d71-e040e8098fd2 with Priority: HIGHEST for action port [ 794.734888] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 794.735149] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 794.735345] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f8b51d-04ae-46ad-9d71-e040e8098fd2 with Priority: HIGHEST for action port [ 794.735813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.735985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.736083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.736444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.736602] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.737743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.737941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.738085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.738394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.739325] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.739325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.739325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.739325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.739325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.739553] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.740426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.740545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.740600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.741053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.741053] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6f8b51d-04ae-46ad-9d71-e040e8098fd2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.742672] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.742849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.743377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.743651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.744094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.764235] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 794.936261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.936395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.936395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.936606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.936691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.936791] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 794.970285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.970421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.970493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.970704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.970853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.980593] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 795.246322] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.247447] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.247562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.247929] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6f8b51d-04ae-46ad-9d71-e040e8098fd2 with status ACTIVE [ 795.248108] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.248222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.248290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.248502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.248592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.248758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.248853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.248916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.249145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.249240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.249454] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.249553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.249617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.249769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.249846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.249930] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6f8b51d-04ae-46ad-9d71-e040e8098fd2 is going to be updated. [ 795.272785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.272930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.273491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.273491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.273491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.273491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6f8b51d-04ae-46ad-9d71-e040e8098fd2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.377169] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f in Status: SUCCESS [ 795.377374] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f deletion is rescheduled due to dependency. [ 795.377482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.561818] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84af9696-6508-477b-a988-cda90bb86706 in Status: SUCCESS [ 795.562112] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84af9696-6508-477b-a988-cda90bb86706 deletion is rescheduled due to dependency. [ 795.562652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.749334] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.252247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.253409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.253409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.253409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.253409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.253669] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be created. [ 796.281268] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.281684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.282199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.282199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.282359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.296045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: UNINITIALIZED for 2s [ 796.782794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 796.783038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.991485] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 796.991856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.772214] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-f42ea887-4df2-4590-aaec-eb88f69720bc tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 797.772792] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 797.773182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.773385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.102329] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.102329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.102329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.102991] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.103712] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.104520] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.104821] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.105239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.105489] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.106799] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.106799] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.106799] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.106799] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.106799] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.106799] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.106799] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.129265] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.129265] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.129573] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.129573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.129887] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-77f63187-3676-4f9f-bd94-234ed60be8ab taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.130081] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.130209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.130659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.130800] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f63187-3676-4f9f-bd94-234ed60be8ab',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.308385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 798.308717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.308989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.309337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.309999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.309999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.309999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.310239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.310285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.310415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.310568] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.311729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.312023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.312243] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.312441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.312514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.312735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.312860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.312997] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.633731] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.634013] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.634139] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.634430] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.634584] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.634766] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 77f63187-3676-4f9f-bd94-234ed60be8ab not found, creating... [ 798.634991] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.635162] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.635279] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.635570] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.635634] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.636911] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.636911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.636911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.636911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.636911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.636911] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 77f63187-3676-4f9f-bd94-234ed60be8ab is going to be created. [ 798.660561] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.660561] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.660561] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.660839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.661080] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.661308] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.815683] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.815990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.816186] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.319704] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.447496] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-858dc071-9d9c-4ce6-aa50-dfc66e006b77 service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 799.447496] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-858dc071-9d9c-4ce6-aa50-dfc66e006b77 service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 799.447496] env[65973]: INFO networking_nsxv3.common.synchronization [req-000efe54-b7d6-4530-8d7b-d8a294b82daf req-858dc071-9d9c-4ce6-aa50-dfc66e006b77 service nova] Enqueued Resource ID: 77f63187-3676-4f9f-bd94-234ed60be8ab with Priority: HIGHEST for action port [ 799.448063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 799.448363] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 799.448740] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f63187-3676-4f9f-bd94-234ed60be8ab with Priority: HIGHEST for action port [ 799.449168] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.449460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.449808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.450150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.450482] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-77f63187-3676-4f9f-bd94-234ed60be8ab taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.451032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.451032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.451273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.451461] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f63187-3676-4f9f-bd94-234ed60be8ab',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.826965] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.827397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.827397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.827589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.827682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.827781] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 799.867035] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.867035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.867035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.867035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.867297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.878442] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 799.956215] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77f63187-3676-4f9f-bd94-234ed60be8ab with status ACTIVE [ 799.956215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.956215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.956215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.956215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.956215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.956215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.956215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.956884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.956884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.956884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.956884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.956884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.956884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.957206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.957206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.957309] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77f63187-3676-4f9f-bd94-234ed60be8ab is going to be updated. [ 799.982499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.982667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.982719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.984612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.984612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.984612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77f63187-3676-4f9f-bd94-234ed60be8ab" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.607355] env[65973]: INFO networking_nsxv3.common.synchronization [req-48a1b949-6b66-4789-84be-ef19fef0e71b req-5d37b237-fce5-4709-ab40-a6b5a78189ce tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 800.608276] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 800.608755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.609051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.609051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.609346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.609595] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.609752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.609839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.610109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.610248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.610422] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.627443] env[65973]: INFO networking_nsxv3.common.synchronization [req-9076480c-ecd9-4c11-be6b-d846501c94d0 req-196b1284-550d-49bc-bc22-e491f0c99203 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 800.629189] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 800.630861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.631049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.631157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.631531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.631789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.631946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.632055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.632288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.632419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.632562] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.036980] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.037463] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.037463] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.037656] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.039602] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.039602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.039602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.039602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.039602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.039602] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.039602] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.039602] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.039602] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.039602] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.039602] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.040246] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.071936] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.072130] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.072130] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.072295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.072614] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-f59fc83b-b615-4310-9d55-8a78f949f5bd taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.072778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.072976] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.073243] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.073376] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f59fc83b-b615-4310-9d55-8a78f949f5bd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.113484] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.135656] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.135818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.135890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.137051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.137051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.137459] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 already deleted. [ 801.137459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.576866] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.577112] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.577269] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.577563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.577935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.577935] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port f59fc83b-b615-4310-9d55-8a78f949f5bd not found, creating... [ 801.578262] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.578368] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.578477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.578711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.578842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.579140] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.579395] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.579442] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.579627] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.579746] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.579880] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: f59fc83b-b615-4310-9d55-8a78f949f5bd is going to be created. [ 801.603306] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.603640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.603862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.604230] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.605187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.605187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.615786] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.715033] env[65973]: INFO networking_nsxv3.common.synchronization [req-9e189894-8ffa-44d1-9dd2-3103f118d66d req-4b6c5643-13bf-4e5d-954e-5d744a2fc75b tempest-ListServersNegativeTestJSON-889699918 tempest-ListServersNegativeTestJSON-889699918-project-member] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 801.715033] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGHEST for action security_group_members [ 801.715033] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.715033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.888412] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 801.888626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.888793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.889017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.890165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.890165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.890165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.890165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.890165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.890165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.890668] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.890668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.890668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.890668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.890869] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.890869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.890869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.891016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.891095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.891171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.891261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.892848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.892949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.893052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.893153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.893215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.893367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.893436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.893609] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.119450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.119995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.120061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 802.156482] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.156618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.156673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.157086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.157086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.169860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 802.368330] env[65973]: INFO networking_nsxv3.common.synchronization [req-9076480c-ecd9-4c11-be6b-d846501c94d0 req-1f3833aa-763f-4429-ad93-ec56868ee93e service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 802.368330] env[65973]: INFO networking_nsxv3.common.synchronization [req-9076480c-ecd9-4c11-be6b-d846501c94d0 req-1f3833aa-763f-4429-ad93-ec56868ee93e service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 802.368517] env[65973]: INFO networking_nsxv3.common.synchronization [req-9076480c-ecd9-4c11-be6b-d846501c94d0 req-1f3833aa-763f-4429-ad93-ec56868ee93e service nova] Enqueued Resource ID: f59fc83b-b615-4310-9d55-8a78f949f5bd with Priority: HIGHEST for action port [ 802.369044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 802.369249] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 802.369452] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc83b-b615-4310-9d55-8a78f949f5bd with Priority: HIGHEST for action port [ 802.369787] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.369912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.369978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.370269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.370357] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.371317] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.371436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.371507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.371718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.371875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.371976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.373125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.373125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.373125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.373125] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.379162] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f59fc83b-b615-4310-9d55-8a78f949f5bd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.379162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.379162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.379162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.379162] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f59fc83b-b615-4310-9d55-8a78f949f5bd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.398141] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ffb193-a19e-4e24-a26f-e10ccbe9a34e: rpc.has_security_group_logging(os_id): False [ 802.398931] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.419288] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.419469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.419532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.419850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.419850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.420064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.420173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.420599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.420599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.420599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.420784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.420784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.420784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.421038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.421038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.421179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.421258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.421441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.421499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.421553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.421601] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be created. [ 802.506219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.506507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.506780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.506937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.507258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.526168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 802.880523] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.880710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.880977] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.882082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f59fc83b-b615-4310-9d55-8a78f949f5bd with status ACTIVE [ 802.882275] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.882421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.882526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.882757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.883116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.883116] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.883266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.883266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.883382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.883465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.883650] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.883749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.883839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.884115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.884227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.884227] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f59fc83b-b615-4310-9d55-8a78f949f5bd is going to be updated. [ 802.901261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.908895] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.909656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.909656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.909656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.909656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.909964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f59fc83b-b615-4310-9d55-8a78f949f5bd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.386511] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.406027] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.406027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.406027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.406027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.406027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.406027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 803.445614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.445783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.445833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.446228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.446228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.457610] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 803.888595] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.888803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.888885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.889109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.889197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.889294] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be created. [ 803.913239] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.913544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.913544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.913706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.913818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.923983] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: UNINITIALIZED for 2s [ 804.184589] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 804.184968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.185155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.185394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.185628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.185725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.185831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.186020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.186150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.186242] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.541615] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 804.542260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.542260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.542409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.542409] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.690043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.690255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.690343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.690723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.690896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.691235] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.691409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.691661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.692516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.692567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.693507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be updated. [ 804.755519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.755761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.755816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.756118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.756291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.769042] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: IN_PROGRESS for 2s [ 805.044443] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.044627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.470427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 805.470427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.473965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.474246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.474464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.474825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.474825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.474825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.475138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.475138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.475138] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.938836] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 805.938836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.938836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.939866] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.939866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.939866] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.977318] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.978060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.978060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.978060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.978307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.978307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.978473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.978690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.978784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.978882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.979085] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.979204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.979204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.979451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.979612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.979705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.979763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.980021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.980021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.980233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.980233] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.442598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.442761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.442810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.444280] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.444280] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.444280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.444758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.444758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.444758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.444758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.444758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.444983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.444983] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.483326] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ffb193-a19e-4e24-a26f-e10ccbe9a34e: rpc.has_security_group_logging(os_id): False [ 806.508830] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.508985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.509082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.509293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.509407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.510616] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.510767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.510817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.511243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.511243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.511536] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.511642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.512328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.512328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.512328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.512328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.512551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.512594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.512725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.512802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.512891] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 806.578117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.578284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.578358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.578618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.578790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.593726] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 806.782292] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 in Status: SUCCESS [ 806.782455] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 deletion is rescheduled due to dependency. [ 806.782696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.947572] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 806.967374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.967554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.967599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.967842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.967967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.968323] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.968444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.969452] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.969826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.969826] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.969826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.969826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.970086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.970086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.970169] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be created. [ 807.041759] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.041948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.041994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.042206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.042399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.054961] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 807.370054] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 807.370187] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 808.612851] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 808.613276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.997315] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f607f512-5f11-4f06-a41d-e4171e49728a None None] Enqueued Resource ID: 34edae20-882c-421a-8579-4314893bfdd5 with Priority: HIGHEST for action port [ 808.998488] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34edae20-882c-421a-8579-4314893bfdd5 with Priority: HIGHEST for action port [ 808.998979] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-34edae20-882c-421a-8579-4314893bfdd5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.999224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34edae20-882c-421a-8579-4314893bfdd5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.999447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34edae20-882c-421a-8579-4314893bfdd5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.999859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34edae20-882c-421a-8579-4314893bfdd5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.000101] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34edae20-882c-421a-8579-4314893bfdd5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.070985] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 809.070985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.417580] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.417580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.417580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.417580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.417580] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.504633] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34edae20-882c-421a-8579-4314893bfdd5 [ 809.504888] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.504975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.505098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.505368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.505368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.505496] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34edae20-882c-421a-8579-4314893bfdd5 already deleted. [ 809.505539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34edae20-882c-421a-8579-4314893bfdd5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.674582] env[65973]: INFO networking_nsxv3.common.synchronization [req-d4818385-1c82-4aa0-a091-400768c218da req-504b0f43-116d-4bb4-8f70-63e4d7a61f17 tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 809.676341] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 809.676744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.676909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.677019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.677356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.677848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.677965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.678080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.678307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.678405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.678506] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.923141] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.180684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.180684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.180976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.180976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.181320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.181320] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.181500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.181500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.181665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.181790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.181900] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 810.212948] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.213136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.213207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.214203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.214203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.223507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 810.427503] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.930523] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 810.930849] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 811.519547] env[65973]: INFO networking_nsxv3.common.synchronization [req-a7eb04fe-2daf-45ae-aab3-3d98827d2afa req-4606ed00-420d-4994-b320-dc98abbe322e tempest-ServersNegativeTestMultiTenantJSON-547902798 tempest-ServersNegativeTestMultiTenantJSON-547902798-project-member] Enqueued Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 811.520247] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 811.520650] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.520813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.521104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.521900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.521900] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.521900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.522109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.522649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.522912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.523049] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.613356] env[65973]: INFO networking_nsxv3.common.synchronization [None req-422a9081-7e18-413e-9e64-b765632c3544 None None] Enqueued Resource ID: 710d49da-e36b-47b9-8b70-68e094c556f5 with Priority: HIGHEST for action port [ 811.613792] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710d49da-e36b-47b9-8b70-68e094c556f5 with Priority: HIGHEST for action port [ 811.615148] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-710d49da-e36b-47b9-8b70-68e094c556f5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.615148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710d49da-e36b-47b9-8b70-68e094c556f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.615148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710d49da-e36b-47b9-8b70-68e094c556f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.615148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710d49da-e36b-47b9-8b70-68e094c556f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.615148] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710d49da-e36b-47b9-8b70-68e094c556f5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.842187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.842419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.842419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.842583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.855868] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 811.856716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.857562] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 811.885768] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.885928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.886012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.886242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.894119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.894609] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 811.894697] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 811.894838] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 811.932607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.933027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.933027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.933464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.934818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.935019] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 811.948060] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.949144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-712" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.949144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-712" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.949144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-712" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.949144] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.949144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.949467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.949510] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.949659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.949863] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.949982] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.950119] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.950229] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.950334] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.950445] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.950784] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.975544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.975544] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.975544] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.975544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-712" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.975544] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.975544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.975544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.975544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.975544] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107b4d33-5cf1-403c-bbfb-4dc66bca07a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.012132] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.013154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.013154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.013372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.013776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.014054] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 812.025430] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.025599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.025648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.025840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.025969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.026172] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.026283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.026340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.026486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.026553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.026652] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 already deleted. [ 812.026725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.081174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.081174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.081174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.081174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.081174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.081680] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 812.081680] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c83e6a14-269f-4653-a47c-a9fe58834679', '17eb131b-ec3d-49bc-9622-abe4401d0c41', '23be5268-bae9-4d02-addf-8da8a520e87c', 'c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c', '8f329967-b7d9-481b-b6ad-3fa408a45e60', '0397097b-0163-421f-b162-1b4a632f3e6b', '7fa2f368-d181-4d10-aca0-43e8bff0fa28', '8da0d868-de85-4818-aa51-4d52389cba32', 'b43cc61c-6eaf-4868-a452-7def78ad6faa', '220a57f2-5c8d-419c-a2ca-41341c0360f6', 'ccf5934e-9748-40f8-8554-93454e399b70', '696853e1-bf6a-45cf-b719-6db77791522b', '9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c', '25ed87c4-ad1f-48f1-99b0-f293d53e44d4', '8a910cac-c5a7-4f59-a22b-7bcefe80a1b4', '9b7c6cf9-ac89-4439-b7a5-127373b5d3b3', 'a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f', '8bf3c541-0add-4e54-89d3-ee7e90d5c0db', '4b19a464-262b-473d-9f50-535013bda763', '06b3347a-b9e0-4205-b1b0-cc8c55878cbe', 'd1bdd946-26a6-42b9-91bc-053f074c2da1', '7fe395e3-e4a0-40a1-ae54-cd90d98c69f8', '30ffb193-a19e-4e24-a26f-e10ccbe9a34e', '42226ea0-f68b-4929-8753-fb837ff84263', '192ec921-b8c6-4174-b658-05183df07d9e', 'b5b10902-7db9-4679-995c-f5b279ca6ef4', 'f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2', '3b841c0a-397f-4e9d-b02d-5feeaebf26a7', '1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de', 'ab67debe-f546-499b-8301-c37179fecdee', '13b6ff97-cb4a-4c76-b07b-2e08a7615d07', 'b8ee6965-6080-4005-80bf-0264af4bd437', '9dcf9f05-2312-463f-a10f-331dffd06aeb', '9c8604cf-439a-4fd5-aaaf-d59a1eb46a27', '84af9696-6508-477b-a988-cda90bb86706', '7a7ed067-ae07-49f5-b03a-aa95774538ec', '12bf28a0-51ca-4171-b63e-ba9ad7a0139e', '78d1f177-ec77-4d3a-bc27-48a23b238428'} {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.081680] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 812.101234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.101445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.101445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.101663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.101751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.101855] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 812.101926] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.101989] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 812.117244] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 710d49da-e36b-47b9-8b70-68e094c556f5 [ 812.117429] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.117533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.117595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.118133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.118133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.118133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:710d49da-e36b-47b9-8b70-68e094c556f5 already deleted. [ 812.118133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710d49da-e36b-47b9-8b70-68e094c556f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.182839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.183063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.183063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.183267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.184368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.184368] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 812.184368] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.184544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 812.184544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 812.184544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 812.184701] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 812.184701] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGH for action security_group_rules [ 812.184768] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGH for action security_group_rules [ 812.184912] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGH for action security_group_rules [ 812.184912] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGH for action security_group_rules [ 812.184998] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGH for action security_group_rules [ 812.184998] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGH for action security_group_rules [ 812.185094] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 812.185131] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGH for action security_group_rules [ 812.185542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGH for action security_group_rules [ 812.185883] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGH for action security_group_rules [ 812.185883] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGH for action security_group_rules [ 812.185883] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGH for action security_group_rules [ 812.185883] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGH for action security_group_rules [ 812.185883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.233539] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 812.233876] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e deletion is rescheduled due to dependency. [ 812.234027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.478989] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.478989] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.478989] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.479309] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.479309] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.479459] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 not found, creating... [ 812.479723] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.479872] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.479978] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.480260] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.480447] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.480741] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.480890] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.481317] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.481660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.481892] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.482098] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 is going to be created. [ 812.513022] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.513247] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.513368] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.513680] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.513908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.514143] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.286675] env[65973]: INFO networking_nsxv3.common.synchronization [req-a7eb04fe-2daf-45ae-aab3-3d98827d2afa req-e2da7f88-6b23-4cf2-9f60-aefcee54506f service nova] Enqueued Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_rules [ 813.287434] env[65973]: INFO networking_nsxv3.common.synchronization [req-a7eb04fe-2daf-45ae-aab3-3d98827d2afa req-e2da7f88-6b23-4cf2-9f60-aefcee54506f service nova] Enqueued Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 813.287712] env[65973]: INFO networking_nsxv3.common.synchronization [req-a7eb04fe-2daf-45ae-aab3-3d98827d2afa req-e2da7f88-6b23-4cf2-9f60-aefcee54506f service nova] Enqueued Resource ID: 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 with Priority: HIGHEST for action port [ 813.289036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_rules [ 813.289036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 813.289036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 with Priority: HIGHEST for action port [ 813.289036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 813.289568] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23be5268-bae9-4d02-addf-8da8a520e87c with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b19a464-262b-473d-9f50-535013bda763 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696853e1-bf6a-45cf-b719-6db77791522b with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43cc61c-6eaf-4868-a452-7def78ad6faa with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0397097b-0163-421f-b162-1b4a632f3e6b with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGH for action security_group_rules [ 813.293194] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.293194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.293194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.294421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.294421] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.294863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.295032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.295172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.295270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.295433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.295569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.295638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.295772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.295853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.295950] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.296924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.296924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.297107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.297257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.297338] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107b4d33-5cf1-403c-bbfb-4dc66bca07a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.299220] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.299220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.299220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.299220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.299220] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.301539] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23be5268-bae9-4d02-addf-8da8a520e87c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.301539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.301539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.301539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.301539] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23be5268-bae9-4d02-addf-8da8a520e87c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.302736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.302885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.303054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.303162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.303162] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa2f368-d181-4d10-aca0-43e8bff0fa28',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.305069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.305069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.305069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.305069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.305069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a910cac-c5a7-4f59-a22b-7bcefe80a1b4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.306842] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.306842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.306842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.306842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.307089] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b3347a-b9e0-4205-b1b0-cc8c55878cbe',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.308335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b19a464-262b-473d-9f50-535013bda763 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.308335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.308335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.308335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.308335] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b19a464-262b-473d-9f50-535013bda763',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.309632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.309632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.309812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.309877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.310143] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.310937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.311070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.311119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.314946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.315045] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.315339] env[65973]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 813.316090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.316202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.316269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.316439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.316579] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ed87c4-ad1f-48f1-99b0-f293d53e44d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.317508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.317508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.317636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.317693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.317790] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b7c6cf9-ac89-4439-b7a5-127373b5d3b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.318649] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.318755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.318820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.318971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.319057] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.319874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-696853e1-bf6a-45cf-b719-6db77791522b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.319997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.320074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.320202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.320284] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('696853e1-bf6a-45cf-b719-6db77791522b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.486829] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.486829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.487057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.487231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.487381] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.489215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220a57f2-5c8d-419c-a2ca-41341c0360f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.489215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.489215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.489482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.489816] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220a57f2-5c8d-419c-a2ca-41341c0360f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.491216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43cc61c-6eaf-4868-a452-7def78ad6faa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.491852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.492136] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43cc61c-6eaf-4868-a452-7def78ad6faa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.493568] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0397097b-0163-421f-b162-1b4a632f3e6b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.493749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.493869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.494158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.494299] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0397097b-0163-421f-b162-1b4a632f3e6b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.495652] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.495828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.496069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.496199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.499051] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.499051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.499051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.499051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.499051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.499051] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.499051] env[65973]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 813.499920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17eb131b-ec3d-49bc-9622-abe4401d0c41 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.499920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.499920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.500160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.500160] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17eb131b-ec3d-49bc-9622-abe4401d0c41',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.501369] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.501548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.502043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.502043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.502043] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.507874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.507874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.514028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.514028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.514264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.514427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.514630] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.514807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.514907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.515258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.515258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.515379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.515504] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.518785] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.525136] env[65973]: INFO networking_nsxv3.common.synchronization [None req-776195ea-a573-4743-a985-fe268e78ca94 None None] Enqueued Resource ID: 6fd39b5e-728f-4145-8743-83be4c038f1d with Priority: HIGHEST for action port [ 813.530069] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd39b5e-728f-4145-8743-83be4c038f1d with Priority: HIGHEST for action port [ 813.533796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fd39b5e-728f-4145-8743-83be4c038f1d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.534309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fd39b5e-728f-4145-8743-83be4c038f1d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.534309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fd39b5e-728f-4145-8743-83be4c038f1d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.534309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fd39b5e-728f-4145-8743-83be4c038f1d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.534642] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd39b5e-728f-4145-8743-83be4c038f1d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.544202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.544385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.544473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.544727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.571265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.571392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23be5268-bae9-4d02-addf-8da8a520e87c is going to be deleted. [ 813.624601] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.624601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.624601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.624601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.624601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.625425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23be5268-bae9-4d02-addf-8da8a520e87c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.633777] env[65973]: INFO networking_nsxv3.common.synchronization [req-a6e66f8d-249a-4b6d-8372-0cef2bdb0890 req-30ef0299-0c54-48f9-b161-39806a0251c2 tempest-SecurityGroupRulesNegativeTestJSON-1722564594 tempest-SecurityGroupRulesNegativeTestJSON-1722564594-project-member] Enqueued Resource ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d with Priority: HIGHEST for action security_group_rules [ 813.633848] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d with Priority: HIGHEST for action security_group_rules [ 813.634408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.634408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.634408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.634656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.634656] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918fb23c-4c2f-4842-b671-c2bdac1ace4d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.800393] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 with status ACTIVE [ 813.800393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.800393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.800393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.800699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.800748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.800963] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.801079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.801165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.801481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.801481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.801702] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.801702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.801702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.801874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.801936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.801995] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 107b4d33-5cf1-403c-bbfb-4dc66bca07a7 is going to be updated. [ 813.824423] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.824673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.824673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.824918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.825093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.825256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107b4d33-5cf1-403c-bbfb-4dc66bca07a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.024167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.024488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.024488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.024733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.024733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.024869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.024912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.025074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.025161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.025252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.025615] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.025615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.025615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.026262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.026262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.026262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.026262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.026262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.026508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.026508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.026508] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.028460] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.041583] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fd39b5e-728f-4145-8743-83be4c038f1d [ 814.041810] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.041937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.042089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.042242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.042328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.042425] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fd39b5e-728f-4145-8743-83be4c038f1d already deleted. [ 814.042532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fd39b5e-728f-4145-8743-83be4c038f1d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.059842] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.060103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.061261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.061261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.061686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.061785] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.063238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.063408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.063485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.063715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.064228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.064412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.064519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.064716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.064901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.065148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.065431] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.103181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.103700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.103700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.103839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.109167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.109317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.113265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.113265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.120935] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.121063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.122011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.122170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.123017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.123149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.124063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.124170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.124911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.125032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.128497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.128497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.131249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.131855] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220a57f2-5c8d-419c-a2ca-41341c0360f6 is going to be deleted. [ 814.132713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.132945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.160428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.160428] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0397097b-0163-421f-b162-1b4a632f3e6b is going to be deleted. [ 814.161362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.161570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.184648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.184648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b3347a-b9e0-4205-b1b0-cc8c55878cbe is going to be deleted. [ 814.185073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.185073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.208305] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.208305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.212032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.212250] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43cc61c-6eaf-4868-a452-7def78ad6faa is going to be deleted. [ 814.213381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.213736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.230026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.230868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.243859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.244000] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b19a464-262b-473d-9f50-535013bda763 is going to be deleted. [ 814.245023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.245256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.271667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.271909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.286231] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.286350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.295837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.296218] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a910cac-c5a7-4f59-a22b-7bcefe80a1b4 is going to be deleted. [ 814.297035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.331178] env[65973]: INFO networking_nsxv3.common.synchronization [req-91009481-aa8b-40b7-940c-2ed4d98aeb24 req-9be08f44-a02e-41e8-87f3-ee3ff73b0602 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 814.331878] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 814.332175] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.332256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.332319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.332647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.332778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.332899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.333060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.333202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.333328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.333505] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.335519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.335670] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 696853e1-bf6a-45cf-b719-6db77791522b is going to be deleted. [ 814.337408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.337550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.337643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.338754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.338754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.338905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b19a464-262b-473d-9f50-535013bda763" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.339878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.340203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.414987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.415903] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ed87c4-ad1f-48f1-99b0-f293d53e44d4 is going to be deleted. [ 814.416498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.416751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.416853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.416979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220a57f2-5c8d-419c-a2ca-41341c0360f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.417158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.417538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.417817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.417955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0397097b-0163-421f-b162-1b4a632f3e6b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.418532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.418744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.418836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.418956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b3347a-b9e0-4205-b1b0-cc8c55878cbe" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.419350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.419628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.419726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.419894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43cc61c-6eaf-4868-a452-7def78ad6faa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.420139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.420341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.423691] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.423833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.460620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.460926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f is going to be deleted. [ 814.463910] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-696853e1-bf6a-45cf-b719-6db77791522b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.463910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.464383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a910cac-c5a7-4f59-a22b-7bcefe80a1b4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.528968] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 814.530528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.530697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.530924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.531240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.531811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.533262] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 is going to be created. [ 814.538227] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.538391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.538487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.538753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.538862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.541019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ed87c4-ad1f-48f1-99b0-f293d53e44d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.568825] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.569077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.569077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.569224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.569383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.569527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.569597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.569988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.570118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.570208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.570374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.570506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.570980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.571253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.571492] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.571492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.571492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.571806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.571806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.571806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.571979] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.572935] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.578133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.578133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.578133] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.578133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.578133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.578930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.578930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.578930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.578930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.578930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.578930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.579150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.579150] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.581041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.581041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.581041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.581041] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.586389] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.586537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.586583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.586772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.588087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.588335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.588335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.588478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.590272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.590272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.590272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.590272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.590272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.590272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.590272] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.591361] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.591497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.591551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.591730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.591898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.593992] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.594189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.617278] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.617458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.618676] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: UNINITIALIZED for 2s [ 814.620113] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.620245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.626437] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.626685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.630048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.630364] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.630580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.630580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.630780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.630914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.631157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.631265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.631322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.631510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.631591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.631778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.631851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.631914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.632341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.632431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.632542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 814.633731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.633947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.634063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.634191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a23f2f80-2cfe-41a5-a08d-59ed3bc8f27f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.634925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.635126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.681836] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.682019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.697035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.697330] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa2f368-d181-4d10-aca0-43e8bff0fa28 is going to be deleted. [ 814.698694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.698972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.746852] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-415 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.748575] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.748575] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.748575] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.748575] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.749245] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.749245] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.749340] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.749577] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.749926] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.750150] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.750360] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.750579] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.750776] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.751641] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.751641] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.794193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.794331] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b7c6cf9-ac89-4439-b7a5-127373b5d3b3 is going to be deleted. [ 814.795360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.795601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.824288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.824288] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.073 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.824288] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.824288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-415" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.824563] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-86fdca7e-4fd6-4b8b-a250-b712da7faba0 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.824895] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.825144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.825538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.825696] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86fdca7e-4fd6-4b8b-a250-b712da7faba0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.837285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.837574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.842033] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.846799] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.846799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.851301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.851460] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17eb131b-ec3d-49bc-9622-abe4401d0c41 is going to be deleted. [ 814.852566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.852787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.852897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.852997] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d already deleted. [ 814.853088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.853835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.854028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.854195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.855638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.855872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.855946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.856155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa2f368-d181-4d10-aca0-43e8bff0fa28" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.872935] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 814.914333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.914578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.914647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.914891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.914989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.915159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b7c6cf9-ac89-4439-b7a5-127373b5d3b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.944358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.944358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.944358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.944358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.944358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.944358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17eb131b-ec3d-49bc-9622-abe4401d0c41" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.042757] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9dfda841-959a-4989-9efb-272135b5ec97 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 815.043515] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 815.043901] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.044164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.044252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.044620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.044723] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.085965] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f329967-b7d9-481b-b6ad-3fa408a45e60: rpc.has_security_group_logging(os_id): False [ 815.087743] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.088824] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c: rpc.has_security_group_logging(os_id): False [ 815.090417] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.090587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.090710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.090843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.091068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.091165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.091165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.091319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.091404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.091491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.091636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.091727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.091786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.091922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.092362] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.092362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.092362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.092362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.092564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.092564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.092564] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.093687] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.095390] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.118876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.119218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.119218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.119478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.123294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.123294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.147040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.147040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.147040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.147040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.147709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.147849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.147894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.147963] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 815.149853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.149853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.173869] env[65973]: INFO networking_nsxv3.common.synchronization [None req-85b91f30-a0a2-42f5-a8aa-a3d228e9cfa5 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 815.173869] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 815.174114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.174473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.183534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.184115] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.184115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.184115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.184115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.184115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.184528] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 815.257209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.257209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.257209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.257209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.257209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.258543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.258862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.259086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.259384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.259685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.282950] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 815.282950] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 815.328913] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.329319] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.329545] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.330065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.330249] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.330621] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 86fdca7e-4fd6-4b8b-a250-b712da7faba0 not found, creating... [ 815.331066] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.331582] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.331763] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.333455] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.333711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.334254] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.334546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.334771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.335192] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.335470] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.335780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 is going to be created. [ 815.345253] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.388976] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.389216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.389331] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.389808] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.390064] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.390362] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.572839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.573095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.573145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.573359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.573453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.573552] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 already deleted. [ 815.573636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.573823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.573985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.574085] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.591472] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8da0d868-de85-4818-aa51-4d52389cba32: rpc.has_security_group_logging(os_id): False [ 815.595718] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c: rpc.has_security_group_logging(os_id): False [ 815.598737] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccf5934e-9748-40f8-8554-93454e399b70: rpc.has_security_group_logging(os_id): False [ 815.599942] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf3c541-0add-4e54-89d3-ee7e90d5c0db: rpc.has_security_group_logging(os_id): False [ 815.615068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.615559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.615559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.615674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.618036] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.618036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.618844] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.618960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.620087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.620226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.673832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.674648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.674808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.674932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.675267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.675352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.675499] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 815.677799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.677799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.703157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.703157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.703157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.703157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.703452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.703524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.704122] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.704278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.704341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.704498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.704571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.704776] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.704870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.704923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.705188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.705373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.705545] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 815.706934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.707161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.741759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.742136] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.742275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.742340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.742519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.742607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.742967] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db is going to be updated. [ 815.743852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.745928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.766707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.767174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.767276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.767459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.767562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767659] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 815.791515] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.791798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.791946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.792257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.792504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.807789] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 815.829713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.829884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.829979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.830232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.830383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.837058] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.837245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.837344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.837641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.837834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.842802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.843018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.843315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.843485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.843669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.849706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.849706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.849983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.850092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.850243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.850396] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 815.872011] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 815.875186] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: IN_PROGRESS for 2s [ 815.891031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 815.891655] env[65973]: INFO networking_nsxv3.common.synchronization [req-f1f164b0-333c-4300-a80d-1342de3a2088 req-38d28268-ef21-411e-98c1-b1cd0259cb90 tempest-SecurityGroupRulesNegativeTestJSON-1722564594 tempest-SecurityGroupRulesNegativeTestJSON-1722564594-project-member] Enqueued Resource ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d with Priority: HIGHEST for action security_group_rules [ 815.892142] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d with Priority: HIGHEST for action security_group_rules [ 815.892501] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.892638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.892698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.892887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.892976] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918fb23c-4c2f-4842-b671-c2bdac1ace4d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.945908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.946191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.946280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.946538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.946781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.962830] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 816.097746] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.097929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.098013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.098255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.098349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.098448] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 already deleted. [ 816.098531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [req-91009481-aa8b-40b7-940c-2ed4d98aeb24 req-14aaae35-3bd5-48b3-a280-de93ed8d53c9 service nova] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [req-91009481-aa8b-40b7-940c-2ed4d98aeb24 req-14aaae35-3bd5-48b3-a280-de93ed8d53c9 service nova] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [req-91009481-aa8b-40b7-940c-2ed4d98aeb24 req-14aaae35-3bd5-48b3-a280-de93ed8d53c9 service nova] Enqueued Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 816.185374] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 816.185374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.185374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.185374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.185374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.185374] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.185374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.185374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-86fdca7e-4fd6-4b8b-a250-b712da7faba0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.186314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.186314] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86fdca7e-4fd6-4b8b-a250-b712da7faba0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.421776] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.422136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.422136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.422669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.422808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.422932] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918fb23c-4c2f-4842-b671-c2bdac1ace4d already deleted. [ 816.423056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918fb23c-4c2f-4842-b671-c2bdac1ace4d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630115] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: SUCCESS [ 816.630404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.631081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.631218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.631285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.632048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.632239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.632373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.632503] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.688305] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.688305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.690027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with status ACTIVE [ 816.690027] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.690318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.692805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.692805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.692805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.692805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 is going to be updated. [ 816.724536] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.724536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.724536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.724536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.724536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.724536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.889375] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 816.889733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.045181] env[65973]: INFO networking_nsxv3.common.synchronization [req-8eb0fcc7-2a51-48fc-9e86-830cf71acd46 req-d02ac376-02f3-4cc8-bcc4-954f82647880 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 817.045422] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 817.046029] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.046153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.046270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.049368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.049368] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.049368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.049368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.049368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.049368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.049368] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.135226] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.135413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.135483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.135726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.135946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.136069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.136069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.136222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.136310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.137071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.137977] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.137977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.137977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.137977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.137977] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.138240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.138240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.138306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.138342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.138538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.138640] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.254136] env[65973]: INFO networking_nsxv3.common.synchronization [None req-7c9b619a-6bb9-4a63-b6d9-e4baa25a33cb None None] Enqueued Resource ID: 411cfeaf-cc1a-423a-90c7-abf8f43c507a with Priority: HIGHEST for action port [ 817.254784] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411cfeaf-cc1a-423a-90c7-abf8f43c507a with Priority: HIGHEST for action port [ 817.256509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-411cfeaf-cc1a-423a-90c7-abf8f43c507a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.256633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-411cfeaf-cc1a-423a-90c7-abf8f43c507a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.256692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-411cfeaf-cc1a-423a-90c7-abf8f43c507a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.257359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-411cfeaf-cc1a-423a-90c7-abf8f43c507a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.257359] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('411cfeaf-cc1a-423a-90c7-abf8f43c507a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.300886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 817.301278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.302515] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 817.302515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.550196] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.641015] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f4201e-cce4-4594-984e-4930f6cf0866: rpc.has_security_group_logging(os_id): False [ 817.663260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.663471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.663532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.664408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.664408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.664607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.664685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.664824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.664897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.665541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.665541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.665541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.665541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.665541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.665541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.666025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.666134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.666200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.666354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.666426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.666516] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 is going to be created. [ 817.753082] env[65973]: INFO networking_nsxv3.common.synchronization [req-fc1ad3a1-6b91-4614-a7c1-59f729a090fe req-e8a4218b-8a97-4b46-943c-281b6b18ef20 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 817.753755] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 817.754958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.755164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.755164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.755326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.755513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.756746] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.756875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762964] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 411cfeaf-cc1a-423a-90c7-abf8f43c507a [ 817.762964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.762964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.763176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.763176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.763241] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:411cfeaf-cc1a-423a-90c7-abf8f43c507a already deleted. [ 817.763467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-411cfeaf-cc1a-423a-90c7-abf8f43c507a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.774045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: IN_PROGRESS for 2s [ 817.829542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 817.829868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.888427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 817.888609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.891308] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: SUCCESS [ 817.891530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.905496] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 817.905779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.975299] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 817.975538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.975709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.975937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.976159] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.976272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.976330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.976528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.976606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.976697] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.052343] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.481596] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.555456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.555919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.555919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.556122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.556524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.556618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 818.591230] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.591396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.591469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.591916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.591996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.607151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 818.983610] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.488542] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.490160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.490160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.490160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.490160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.490160] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 819.523726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.523726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.523726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.524072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.524072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.534134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 819.787395] env[65973]: INFO networking_nsxv3.common.synchronization [req-d0cd7644-6c42-4c21-a7fe-204281f4f512 req-0615d1e8-253e-43a5-a107-f28df82f9919 tempest-ListImageFiltersTestJSON-302671947 tempest-ListImageFiltersTestJSON-302671947-project-member] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 819.792023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: SUCCESS [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.792023] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGHEST for action security_group_members [ 819.792023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.792023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.792023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.792023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.296424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.296710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.296710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.297098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.320505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.320876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.321122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.321222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.321607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.321607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.321723] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be updated. [ 820.352064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.352064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.352064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.352338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.352398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.471885] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: IN_PROGRESS for 2s [ 820.621215] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 820.621421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.622130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622130] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.622449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.622449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.622602] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.014908] env[65973]: INFO networking_nsxv3.common.synchronization [req-3f3e321e-ced3-41ce-b142-abeb1b834509 req-6d1c8b46-9802-4fca-94eb-ac3622b4d9b3 tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 821.016537] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 821.021179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.021179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.021179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.021179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.021179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.021418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.021418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.021492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.021528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.022472] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.126028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.126196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.126271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.126525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.151410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.152080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.152080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.152080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.152447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.152447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.152590] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 821.184982] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.185154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.185236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.185459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.185619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.195981] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 821.524448] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.545922] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.548346] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.548346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.548346] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.818923] env[65973]: INFO networking_nsxv3.common.synchronization [req-cd4a2965-6c45-4964-a150-80720a8077da req-a128c493-1eea-4ee3-b379-6c43769996fe tempest-InstanceActionsNegativeTestJSON-951502830 tempest-InstanceActionsNegativeTestJSON-951502830-project-member] Enqueued Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 821.819670] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 821.820110] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.820294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.820395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.820693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.821126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.821126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.821332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.821569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.821707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.822305] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.028055] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.052186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.052831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.052912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.053856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.054069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.054220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.054299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.054485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.054570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.054685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.054805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.054913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.056040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.058023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.058023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.194863] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.195458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-370" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.195458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-370" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.195596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-370" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.195803] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.195966] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.196274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.196274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.196442] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.196725] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.196725] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.196835] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.196835] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.197095] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.197142] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.197398] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.217920] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.218241] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.218320] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.218474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-370" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.218869] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-8e11b58f-ce0a-4424-806b-eaaff75e5942 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.218999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.219079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.219398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.219586] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e11b58f-ce0a-4424-806b-eaaff75e5942',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.327477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.329586] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.329586] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b already deleted. [ 822.329586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.483983] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 in Status: SUCCESS [ 822.484307] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 deletion is rescheduled due to dependency. [ 822.484450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.533720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.533926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.533970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.534227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.534313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.534421] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 822.560470] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 822.584503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.584730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.584730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.585196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.585196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.590937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.591097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.591169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.591382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.595609] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 822.622223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.622477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.622596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.622668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.622870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.622952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.623185] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.623288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.623344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.623505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.623581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.623771] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.623976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.624065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.624217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.624427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.624520] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 822.721900] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.722164] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.722366] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.722683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.722835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.722986] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 8e11b58f-ce0a-4424-806b-eaaff75e5942 not found, creating... [ 822.723443] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.723443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.723605] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.723777] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.723914] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.724221] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.724373] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.724530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.724775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.724915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.725060] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 8e11b58f-ce0a-4424-806b-eaaff75e5942 is going to be created. [ 822.727069] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.727186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.727253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.727431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.727587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.750832] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 822.756263] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.756477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.756600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.756888] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.757135] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.757475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.209634] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 823.210073] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e deletion is rescheduled due to dependency. [ 823.210158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580257] env[65973]: INFO networking_nsxv3.common.synchronization [req-cd4a2965-6c45-4964-a150-80720a8077da req-62a73f1a-acef-458d-b65a-897df77a2d39 service nova] Enqueued Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_rules [ 823.583150] env[65973]: INFO networking_nsxv3.common.synchronization [req-cd4a2965-6c45-4964-a150-80720a8077da req-62a73f1a-acef-458d-b65a-897df77a2d39 service nova] Enqueued Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 823.583150] env[65973]: INFO networking_nsxv3.common.synchronization [req-cd4a2965-6c45-4964-a150-80720a8077da req-62a73f1a-acef-458d-b65a-897df77a2d39 service nova] Enqueued Resource ID: 8e11b58f-ce0a-4424-806b-eaaff75e5942 with Priority: HIGHEST for action port [ 823.583150] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_rules [ 823.583150] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 823.583150] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e11b58f-ce0a-4424-806b-eaaff75e5942 with Priority: HIGHEST for action port [ 823.583150] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.583557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.583557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.583754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.583754] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.584780] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.584780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.584917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.585528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.585528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.585528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.585528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.585528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.585528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.585896] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.590681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e11b58f-ce0a-4424-806b-eaaff75e5942 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.590809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.590877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.591082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.591165] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e11b58f-ce0a-4424-806b-eaaff75e5942',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.097338] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e11b58f-ce0a-4424-806b-eaaff75e5942 with status ACTIVE [ 824.097338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.097338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.097338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.097594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.097594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.099068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.099068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.099068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.099068] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e11b58f-ce0a-4424-806b-eaaff75e5942 is going to be updated. [ 824.100187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.100413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.100860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.123582] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.123777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.123835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.124066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.125119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.125119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e11b58f-ce0a-4424-806b-eaaff75e5942" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.603752] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.606131] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 824.606304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.767824] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 824.767824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.108494] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.108655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.108727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.108992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.109102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.109207] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b is going to be created. [ 825.136067] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.136157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.136228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.136432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.136596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.147237] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: UNINITIALIZED for 2s [ 826.449128] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c7a99602-c30f-49f6-b700-a96496e22bca None None] Enqueued Resource ID: eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a with Priority: HIGHEST for action port [ 826.449128] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a with Priority: HIGHEST for action port [ 826.449128] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.451679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.451679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.453205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.453205] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.955166] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a [ 826.955166] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.955166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.955166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.955528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.955528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.955528] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a already deleted. [ 826.955528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb16fe7a-6ec3-48a8-9f8a-1cef8c8cf41a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.162587] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: SUCCESS [ 827.162862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.163192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.163290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.164286] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.164286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.164286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.164505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.164546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.164675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.164733] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.254248] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 827.254455] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 827.255611] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 827.255827] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 827.256196] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.256427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.256427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.256615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.256687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.256791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.257947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.257947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.257947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.257947] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.258550] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.258550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.258550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.258550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.258728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.258728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.258810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.258917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.259072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.259192] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.318018] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_rules [ 827.318018] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 827.318018] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 827.318018] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 827.318018] env[65973]: INFO networking_nsxv3.common.synchronization [req-99a9bab7-484a-469c-94a0-e28baac14da8 req-b68eec9f-c8b4-401b-bcf9-e2a77a2534db tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 827.319388] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_rules [ 827.319744] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 827.320052] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 827.320273] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 827.320466] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 827.321377] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.321377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.321377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.321377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.322021] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.323710] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.324950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.326185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.326185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.326185] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.327360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-86fdca7e-4fd6-4b8b-a250-b712da7faba0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.327653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.328901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.328901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.328901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86fdca7e-4fd6-4b8b-a250-b712da7faba0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.329636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.329723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.330032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.330032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.548308] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b9c6a5e9-b70c-46a3-a768-eb5da23be4b6 None None] Enqueued Resource ID: a275265b-9dc0-452d-8aa5-cf325969f1a5 with Priority: HIGHEST for action port [ 827.548308] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a275265b-9dc0-452d-8aa5-cf325969f1a5 with Priority: HIGHEST for action port [ 827.548308] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a275265b-9dc0-452d-8aa5-cf325969f1a5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.548308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a275265b-9dc0-452d-8aa5-cf325969f1a5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.548308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a275265b-9dc0-452d-8aa5-cf325969f1a5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.548308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a275265b-9dc0-452d-8aa5-cf325969f1a5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.548927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a275265b-9dc0-452d-8aa5-cf325969f1a5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.667732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.667917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.667962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.668444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.668444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.668444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.668639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.668832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.668935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.669047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.669235] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.669319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.669373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.669604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.670612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.670863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.670863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.672045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.672143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.672234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.672334] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.762088] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.762088] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.828760] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.828898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.833921] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.834321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.834535] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with status ACTIVE [ 827.834747] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.834880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.834949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.836323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.836458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.836683] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.836799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.836861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.837080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.837160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.837368] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.837544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.839558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.839558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.839558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839558] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 is going to be updated. [ 827.864543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.864543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.864543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.864543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.864543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.864543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.052690] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a275265b-9dc0-452d-8aa5-cf325969f1a5 [ 828.052880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.053054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.053134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.053428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.053474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.053624] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a275265b-9dc0-452d-8aa5-cf325969f1a5 already deleted. [ 828.053716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a275265b-9dc0-452d-8aa5-cf325969f1a5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.178140] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b: rpc.has_security_group_logging(os_id): False [ 828.197348] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.197736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.199629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.199629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.199629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.200943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.201168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.201428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.201623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.202051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b is going to be created. [ 828.265181] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.266190] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.270374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.270568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.270747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.270884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.271083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.286173] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: IN_PROGRESS for 2s [ 828.618736] env[65973]: INFO networking_nsxv3.common.synchronization [None req-1bd2ef32-bd58-4b35-a1fa-97bb63857436 tempest-ServerActionsV293TestJSON-334095518 tempest-ServerActionsV293TestJSON-334095518-project-member] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 828.620329] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 828.620329] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.620329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.620329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.622223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.622223] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.751340] env[65973]: INFO networking_nsxv3.common.synchronization [None req-2dab30e3-96fe-4990-a2a0-d955e3b95fc0 tempest-ServerActionsV293TestJSON-334095518 tempest-ServerActionsV293TestJSON-334095518-project-member] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 828.752304] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 828.755145] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.768891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.768891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.768891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.768891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.768891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.768891] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 828.770686] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.770845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.770918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.771461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.771642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.771797] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be created. [ 828.800192] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.800380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.800445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.800690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.800885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.804030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.804121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.804162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.804892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.804892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.815094] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 828.815890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: UNINITIALIZED for 2s [ 828.971112] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8036da8d-21ce-4bc5-9bee-b04b91bab2eb None None] Enqueued Resource ID: 42594a25-5ca3-4346-b558-91761af20d22 with Priority: HIGHEST for action port [ 828.971112] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42594a25-5ca3-4346-b558-91761af20d22 with Priority: HIGHEST for action port [ 828.971816] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-42594a25-5ca3-4346-b558-91761af20d22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.972128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42594a25-5ca3-4346-b558-91761af20d22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.972235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42594a25-5ca3-4346-b558-91761af20d22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.972586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42594a25-5ca3-4346-b558-91761af20d22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.972736] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42594a25-5ca3-4346-b558-91761af20d22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.149039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.149039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.149039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.149436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.149436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.149563] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b already deleted. [ 829.149563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.149814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.149983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.150148] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.313847] env[65973]: INFO networking_nsxv3.common.synchronization [None req-cacb61c7-1009-4016-a5c5-2aa401a6deaf tempest-ServersV294TestFqdnHostnames-665253038 tempest-ServersV294TestFqdnHostnames-665253038-project-member] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 829.313906] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 829.314301] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.314407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.314407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.314896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.315770] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.477531] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42594a25-5ca3-4346-b558-91761af20d22 [ 829.478474] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.478474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.478474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.478474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.478474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.478474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42594a25-5ca3-4346-b558-91761af20d22 already deleted. [ 829.479515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42594a25-5ca3-4346-b558-91761af20d22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.669440] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f291514a-ad25-4a9e-b8c0-ec0c35622703 tempest-ServersV294TestFqdnHostnames-665253038 tempest-ServersV294TestFqdnHostnames-665253038-project-member] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 829.669798] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 829.669984] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.674400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.674400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b already deleted. [ 829.674400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.853189] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.853189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.853189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.853475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.853570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.853670] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 already deleted. [ 829.853766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.854262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.854262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.854262] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.303109] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: SUCCESS [ 830.303693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.376274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.376465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.376465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.376683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.376766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.376856] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 already deleted. [ 830.376932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.456917] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5a1156e3-4477-470d-9c89-dfbfd7284afa None None] Enqueued Resource ID: ee1befbf-cc34-4bbe-a795-b6791813de6e with Priority: HIGHEST for action port [ 830.457578] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1befbf-cc34-4bbe-a795-b6791813de6e with Priority: HIGHEST for action port [ 830.457578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee1befbf-cc34-4bbe-a795-b6791813de6e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.457763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee1befbf-cc34-4bbe-a795-b6791813de6e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.457808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee1befbf-cc34-4bbe-a795-b6791813de6e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.458044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee1befbf-cc34-4bbe-a795-b6791813de6e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.458478] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee1befbf-cc34-4bbe-a795-b6791813de6e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.827598] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 830.827598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.827598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.827598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.827598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.828350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.828350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.828350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.828350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.830334] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.834028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 830.834028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.834028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.834028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.834265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.834265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.834374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.834468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.834551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.834651] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.961561] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee1befbf-cc34-4bbe-a795-b6791813de6e [ 830.961898] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.962096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.962860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.962860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.962860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.962860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee1befbf-cc34-4bbe-a795-b6791813de6e already deleted. [ 830.963068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee1befbf-cc34-4bbe-a795-b6791813de6e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.337377] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.338335] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.839275] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.840504] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.344760] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.345013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.345138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.345477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.345626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.345779] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be updated. [ 832.348298] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.348298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.348298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.349016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.349204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.349379] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 832.368537] env[65973]: INFO networking_nsxv3.common.synchronization [req-43fba114-f418-48d7-8451-55b0735afe1b req-3c886730-e465-40c8-a8fa-7d8b6d174ae5 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 832.370036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 832.370036] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.370036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.370285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.370390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.370901] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.371151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.371291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.371448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.371617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.371681] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.396887] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.396887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.396887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.396887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.396887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.401750] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.401910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.402118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.402394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.402648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.413676] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 832.414927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 832.874631] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.874920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.874920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.875149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.875240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.875464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.875600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.875673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.875855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.875908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.876097] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 832.918406] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.918406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.918406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.918406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.918406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.930392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 833.276655] env[65973]: INFO networking_nsxv3.common.synchronization [req-032ab866-6295-4520-8e63-4507c4449902 req-f0946c9f-a983-4e5e-a40f-eb0501c3ac88 tempest-ServersNegativeTestMultiTenantJSON-547902798 tempest-ServersNegativeTestMultiTenantJSON-547902798-project-member] Enqueued Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 833.277401] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGHEST for action security_group_members [ 833.278720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.278922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.280185] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.280185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.280185] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.785958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.786138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.786238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.786456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.786566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.786893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.787083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.787083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.787237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.787293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.787350] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 is going to be updated. [ 833.825766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.825920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.825991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.826234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.826379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.839061] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: IN_PROGRESS for 2s [ 834.428371] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 834.428371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.428371] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 834.428979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.428979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.428979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.429118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.431890] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.431890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.432318] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.432318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.432318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.433103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.433103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.433103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.433103] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.935206] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.935206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.935206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.935206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.935848] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.938080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.938080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.938080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.938080] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.940347] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 834.940980] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 834.941272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.942034] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.444414] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 835.445612] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a89ecf-5ecf-49af-abb2-fb5522a607f0: rpc.has_security_group_logging(os_id): False [ 835.459992] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 835.459992] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 835.459992] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 835.461574] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 835.461574] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 835.461574] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 835.462673] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.462673] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.462673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.463304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.463304] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.463869] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.464018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.464090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.464258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.464425] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.464523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.464593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.466395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.466395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.466395] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.467241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31f62d3-a722-496e-809e-9313a21fc8c5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.467355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.467421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.467658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.467828] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.467910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.467980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.468152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.468194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.468275] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.471676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.471812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.471882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.472097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.472189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.472658] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.472658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.472658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.472941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.472941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.473059] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be created. [ 835.474981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.475116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.475178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.475599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.475599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.476054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.476054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.476054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.476054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.476274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.476274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.476359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.476409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.476595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.476696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.477054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.477407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.477476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.477634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.477714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.477805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 835.480608] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.526716] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_rules [ 835.526951] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 835.527143] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_rules [ 835.527291] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 835.527428] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 835.527581] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 835.527765] env[65973]: INFO networking_nsxv3.common.synchronization [req-e992f71e-9482-499c-8135-464972c8cbd1 req-86a3e99a-6021-4ab4-b6c4-6270cb5995e1 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 835.528401] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_rules [ 835.528544] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_rules [ 835.528666] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 835.528752] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with Priority: HIGHEST for action port [ 835.528882] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_rules [ 835.529107] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 835.529146] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 835.529502] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.529565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.529849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a31f62d3-a722-496e-809e-9313a21fc8c5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.529948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.529993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.530337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.530394] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.531671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.531770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.532000] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-86fdca7e-4fd6-4b8b-a250-b712da7faba0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.532123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.532179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.532383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.532479] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86fdca7e-4fd6-4b8b-a250-b712da7faba0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.537232] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.537334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.537569] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.537657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.537883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31f62d3-a722-496e-809e-9313a21fc8c5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.537968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.565604] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.565977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.565977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.566228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.566458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.576343] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.576542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.576599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.576814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.576963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.611542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 835.674201] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 835.689054] env[65973]: INFO networking_nsxv3.common.synchronization [None req-3494fe46-a923-4802-a4ec-67b42dae3363 None None] Enqueued Resource ID: 157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd with Priority: HIGHEST for action port [ 835.689054] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd with Priority: HIGHEST for action port [ 835.689308] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.689955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.690177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.690772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.690959] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.848457] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f4201e-cce4-4594-984e-4930f6cf0866 in Status: SUCCESS [ 835.850300] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 deletion is rescheduled due to dependency. [ 835.850300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.982476] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.983875] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.987029] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.037794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86fdca7e-4fd6-4b8b-a250-b712da7faba0 with status ACTIVE [ 836.038073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.038209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.038273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.038497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.038593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.038768] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.038883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.039054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.039159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.039159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.039311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.039431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.039508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.039583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.039657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.039742] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86fdca7e-4fd6-4b8b-a250-b712da7faba0 is going to be updated. [ 836.041228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31f62d3-a722-496e-809e-9313a21fc8c5 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.041228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.066720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.067341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.067341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.067341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.067552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.067860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86fdca7e-4fd6-4b8b-a250-b712da7faba0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.195090] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd [ 836.195294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.195487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.195554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.195752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.195846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.195948] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd already deleted. [ 836.196044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-157347a6-4fa8-40bb-b3ab-aff5fb4d5dcd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.487261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.488731] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.491301] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.491301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.491301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.491652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.491752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.491858] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be updated. [ 836.534964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.535151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.535233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.535441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.535588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.549456] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 836.750471] env[65973]: INFO networking_nsxv3.common.synchronization [req-68f94544-2282-471e-9df1-ca14c326881c req-f6b4cb01-5a62-411c-9bd0-86da144a5c69 tempest-InstanceActionsNegativeTestJSON-951502830 tempest-InstanceActionsNegativeTestJSON-951502830-project-member] Enqueued Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 836.751555] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGHEST for action security_group_members [ 836.751555] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.751555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.751780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.751780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.751932] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.752040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.752103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.752258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.752343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.752438] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.991786] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.991786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.991786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.991978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.992131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.992131] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 836.993954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.994128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.994206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.994398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.994490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.994865] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 is going to be created. [ 837.020813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.020813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.020813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.021317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.025843] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.025843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.025843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.025843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.025843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.035126] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 837.036024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31f62d3-a722-496e-809e-9313a21fc8c5 in Status: UNINITIALIZED for 2s [ 837.255721] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.255833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.255972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.257195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.257195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.257195] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.257195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.257195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.257487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.257487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.257487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b is going to be updated. [ 837.293785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.293785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.293785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.295529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.295529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.305640] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: IN_PROGRESS for 2s [ 837.626035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 837.626035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.626035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.626035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.626035] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.704794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 837.705110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.705328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.705675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.705675] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.128248] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.128544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.209232] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.209459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.561409] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 838.561652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.561837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.562071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.562256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.562410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.562474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.562691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.562787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.562888] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.625124] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ce08c746-77d4-4a78-b9ab-fd7c4f79ff66 None None] Enqueued Resource ID: c5a5e707-6819-40de-9098-17e9e0c4ceba with Priority: HIGHEST for action port [ 838.625771] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a5e707-6819-40de-9098-17e9e0c4ceba with Priority: HIGHEST for action port [ 838.627497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a5e707-6819-40de-9098-17e9e0c4ceba taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.627497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a5e707-6819-40de-9098-17e9e0c4ceba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.627497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a5e707-6819-40de-9098-17e9e0c4ceba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.627916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a5e707-6819-40de-9098-17e9e0c4ceba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.627916] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a5e707-6819-40de-9098-17e9e0c4ceba',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.046791] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 839.047116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.047296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.047549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.047767] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.048166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.048166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.048166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.048339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.048339] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.052130] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31f62d3-a722-496e-809e-9313a21fc8c5 in Status: SUCCESS [ 839.053041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.053259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.053477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.053686] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.053817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.053919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.054393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.054393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.054393] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.067013] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.130184] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5a5e707-6819-40de-9098-17e9e0c4ceba [ 839.130453] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.130616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.130733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.130936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.131080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.131080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5a5e707-6819-40de-9098-17e9e0c4ceba already deleted. [ 839.131157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a5e707-6819-40de-9098-17e9e0c4ceba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.315234] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b in Status: SUCCESS [ 839.315466] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b deletion is rescheduled due to dependency. [ 839.315584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.552533] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.555978] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.569142] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.895646] env[65973]: INFO networking_nsxv3.common.synchronization [req-f058789e-f8e3-47e5-8f61-957b76e4a6ac req-ff15c335-71ee-4cc7-bed1-0115880a1c1d tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 839.896054] env[65973]: INFO networking_nsxv3.common.synchronization [req-f058789e-f8e3-47e5-8f61-957b76e4a6ac req-ff15c335-71ee-4cc7-bed1-0115880a1c1d tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 839.896054] env[65973]: INFO networking_nsxv3.common.synchronization [req-f058789e-f8e3-47e5-8f61-957b76e4a6ac req-ff15c335-71ee-4cc7-bed1-0115880a1c1d tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 839.896504] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 839.896623] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGHEST for action security_group_members [ 839.896738] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31f62d3-a722-496e-809e-9313a21fc8c5 with Priority: HIGHEST for action security_group_members [ 839.897040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.897145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.897440] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.897440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.897647] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a31f62d3-a722-496e-809e-9313a21fc8c5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.897735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.054420] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.058218] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.070537] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.070825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.070912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.071263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.071363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.071467] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be updated. [ 840.102039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.102227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.102324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.102574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.102756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.114090] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 840.556621] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.558862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.558862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.558862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.558862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.558862] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 840.560911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.561147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.561286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.561547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.561645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.561747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 is going to be updated. [ 840.595771] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.595991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.595991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.596248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.596369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.599047] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.599272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.599403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.599727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.599907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612492] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 840.613322] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31f62d3-a722-496e-809e-9313a21fc8c5 in Status: IN_PROGRESS for 2s [ 842.125840] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 842.126271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.126699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.126906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.127117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.127259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.127429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.127479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.127619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.127902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.127902] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.128927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.128927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.129097] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.129097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.129209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.129258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.129337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.129423] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.628182] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 842.628565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.628864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.629204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.629506] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.629774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.630376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.630376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.630376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.630560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.630560] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.631600] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.632725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.632725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.632912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.632987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.633060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.633434] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.633434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.633434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.633603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.633643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.633696] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be updated. [ 842.635352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.635566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.635758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.635854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.635916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.636198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.636263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.636430] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.639874] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a31f62d3-a722-496e-809e-9313a21fc8c5 in Status: SUCCESS [ 842.640178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.640448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.641192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.641486] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.641680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.641802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.642191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.642344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.642498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.642675] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.646237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.646500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.646859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.647060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.647175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.647445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.647529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.647860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.694584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.694744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.694828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.695041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.695179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.706975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 843.139233] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a89ecf-5ecf-49af-abb2-fb5522a607f0: rpc.has_security_group_logging(os_id): False [ 843.140736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.140874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.144685] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a31f62d3-a722-496e-809e-9313a21fc8c5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.145409] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.151107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.151262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.151341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.151554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.151645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.152071] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.152071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.152071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.152250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.152250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.152323] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 is going to be deleted. [ 843.158908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.159055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.159127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.159415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.159479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.159728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.159831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.159892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.160077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.160153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.160232] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be updated. [ 843.187323] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.187533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.187668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.187919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.188047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.188141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.221756] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.222016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.222122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.222402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.222595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.240159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: IN_PROGRESS for 2s [ 843.647901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.649038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a31f62d3-a722-496e-809e-9313a21fc8c5: rpc.has_security_group_logging(os_id): False [ 843.667174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.667375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.667454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.667756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.667852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.668103] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.668202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.668500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.668500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.668500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.668679] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 is going to be created. [ 843.686314] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5], does not exist path=[/infra/domains/default/groups/a31f62d3-a722-496e-809e-9313a21fc8c5]."\n}' [ 843.686467] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5 [ 843.686549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 843.723782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.723943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.724021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.724244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.725068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.725327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.725437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.725498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.725662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.725740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.725936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.726045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.726102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.726240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.726310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.726391] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a31f62d3-a722-496e-809e-9313a21fc8c5 is going to be created. [ 843.755398] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5], does not exist path=[/infra/domains/default/groups/a31f62d3-a722-496e-809e-9313a21fc8c5]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5 [ 843.755600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a31f62d3-a722-496e-809e-9313a21fc8c5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.756248] env[65973]: Traceback (most recent call last): [ 843.756295] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 843.756295] env[65973]: return func(*args, **kwargs) [ 843.756295] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 843.756295] env[65973]: res.raise_for_status() [ 843.756295] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 843.756295] env[65973]: raise HTTPError(http_error_msg, response=self) [ 843.756295] env[65973]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5 [ 843.756295] env[65973]: During handling of the above exception, another exception occurred: [ 843.756295] env[65973]: Traceback (most recent call last): [ 843.756295] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 843.756295] env[65973]: listener.cb(fileno) [ 843.756745] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 843.756745] env[65973]: result = function(*args, **kwargs) [ 843.756745] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 843.756745] env[65973]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 843.756745] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 843.756745] env[65973]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 843.756745] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 843.756745] env[65973]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 843.756745] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 843.756745] env[65973]: res.raise_for_status() [ 843.756745] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 843.756745] env[65973]: raise HTTPError(http_error_msg, response=self) [ 843.756745] env[65973]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a31f62d3-a722-496e-809e-9313a21fc8c5 [ 843.756745] env[65973]: Removing descriptor: 5 [ 844.151289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.151641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.151641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.152560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.152560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.152560] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 844.185408] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.185999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.185999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.186493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.186792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.198979] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 844.719533] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 844.719533] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 deletion is rescheduled due to dependency. [ 844.719533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.897409] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 844.897563] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 845.262899] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 in Status: SUCCESS [ 845.262899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.211862] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 846.211862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.211862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.211862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.212865] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.212865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.212865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.213211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.213211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.213355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.213606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.214323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.214323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.214323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.214323] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.214323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.214611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.214829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.214829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.215901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.215901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.719352] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b10902-7db9-4679-995c-f5b279ca6ef4: rpc.has_security_group_logging(os_id): False [ 846.739807] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.740049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.740049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.740783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.762281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.762733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.762733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.762733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.763149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.763149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.763352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.763352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.763352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.763634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.763634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.764041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.764041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.764041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.764041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.764458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.764458] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 846.832497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.832663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.832709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.832957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.833128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.850696] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 847.600345] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-880ebe45-9aac-4b1e-b0f6-5b5208a2f519 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 847.601096] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 847.601809] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.602094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.602094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.602326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.602503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.602698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.602775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.602965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.603068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.603183] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.979346] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-c5d35b36-d23d-42ac-b14e-0f7c37674087 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 847.979346] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 847.979346] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.979346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.106554] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.106554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.106554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.110127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.110127] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 already deleted. [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.110127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.110127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.111424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.111424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.111573] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.418062] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-e9cc09c2-6981-4cda-b550-4b143f75f526 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 848.418617] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 848.418998] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.419118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.590298] env[65973]: INFO networking_nsxv3.common.synchronization [req-555803de-833d-471b-83c3-e8d08f4007cb req-65c0668f-bac0-451c-b075-7d0e0a4dddfd tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 848.591060] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 848.591436] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.591604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.591702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.591935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.592371] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.592524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.592611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.592810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.592929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.593074] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.614625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.615923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.615923] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 already deleted. [ 848.615923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.616484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.616484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.616625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.616874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.616874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.616970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.616970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.617190] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.861343] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-972 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.861625] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.861912] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.862149] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.862415] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.862570] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.862717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.862915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.863094] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.863809] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.863809] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.863809] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.863809] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.863809] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.863809] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.864193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.874168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 848.874483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.883975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.884232] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.884415] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.884655] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.885167] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-356261c6-3bca-4889-960d-506018af9e4e taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.885437] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.885596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.885993] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.886256] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('356261c6-3bca-4889-960d-506018af9e4e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.097096] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.120471] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.120696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.120696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.121836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.121836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.121836] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.121836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.121836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.121836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.122867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.122867] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 already deleted. [ 849.122867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.391077] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.391380] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.391508] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.391787] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.391937] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.392130] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 356261c6-3bca-4889-960d-506018af9e4e not found, creating... [ 849.392405] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.392597] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.392719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.392951] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.393100] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.393393] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.393544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.393657] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.393901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.395124] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.395307] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 356261c6-3bca-4889-960d-506018af9e4e is going to be created. [ 849.419288] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.419594] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.420257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.420577] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.420896] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.421185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.599365] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.101477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.104369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.104369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.104369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.104369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.104369] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 850.132112] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.132112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.132112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.132112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.132112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.144349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 850.157059] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-804073de-afda-4824-9ea5-015d56cb6677 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 850.157059] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-804073de-afda-4824-9ea5-015d56cb6677 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 850.157059] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-804073de-afda-4824-9ea5-015d56cb6677 service nova] Enqueued Resource ID: 356261c6-3bca-4889-960d-506018af9e4e with Priority: HIGHEST for action port [ 850.157732] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 850.157732] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 850.157732] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 356261c6-3bca-4889-960d-506018af9e4e with Priority: HIGHEST for action port [ 850.158113] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.158237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.159579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.159579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.159579] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.159579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.160318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.160318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.160318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.160318] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.160318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.160318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.163225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.163225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.163225] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.163225] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-356261c6-3bca-4889-960d-506018af9e4e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.163225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.163225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.163225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.163225] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('356261c6-3bca-4889-960d-506018af9e4e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.662081] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.664870] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.665035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.665162] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 356261c6-3bca-4889-960d-506018af9e4e with status ACTIVE [ 850.665332] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.665710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.665710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.665710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.665897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.669160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.669364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.669439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.669634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.670025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.670428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.670549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.670614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.670798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.670970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.671144] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 356261c6-3bca-4889-960d-506018af9e4e is going to be updated. [ 850.695011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.695253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.695253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.695976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.695976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.695976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-356261c6-3bca-4889-960d-506018af9e4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.746203] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e3925299-2a7c-476c-8ea9-78dc10c4d394 None None] Enqueued Resource ID: ab361b20-4577-4f78-b9b0-627ee27e7404 with Priority: HIGHEST for action port [ 850.746759] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab361b20-4577-4f78-b9b0-627ee27e7404 with Priority: HIGHEST for action port [ 850.751116] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab361b20-4577-4f78-b9b0-627ee27e7404 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.751331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab361b20-4577-4f78-b9b0-627ee27e7404" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.751456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab361b20-4577-4f78-b9b0-627ee27e7404" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.751640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab361b20-4577-4f78-b9b0-627ee27e7404" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.751728] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab361b20-4577-4f78-b9b0-627ee27e7404',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.797147] env[65973]: INFO networking_nsxv3.common.synchronization [req-ebd78903-ca0d-4f6c-ac3f-698040b2c6cc req-6b0085c0-bbe3-4f3c-969e-7f2bebcc5b32 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 850.798492] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 850.799777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.799994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.800101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.800381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.800781] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.800908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.800985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.801157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.801246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.801348] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.155624] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-440 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.155934] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.155934] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.156292] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.156553] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.156712] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.158316] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.158877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.158877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.159054] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.159189] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.159425] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.159425] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.159547] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.159602] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.159794] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.165045] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.179256] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.179389] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.179530] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.181130] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.181549] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-70c8babe-d476-4541-95df-992602ac6cb6 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.181740] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.181862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.182219] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.182356] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70c8babe-d476-4541-95df-992602ac6cb6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.254446] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab361b20-4577-4f78-b9b0-627ee27e7404 [ 851.254782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.255768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.255768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.255768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.255768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.255768] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab361b20-4577-4f78-b9b0-627ee27e7404 already deleted. [ 851.255768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab361b20-4577-4f78-b9b0-627ee27e7404" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.306300] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.306300] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.306300] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de already deleted. [ 851.306300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.367122] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.367122] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.367122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.367837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.368167] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.368382] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.368583] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.368778] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.369020] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.369227] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.369466] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.387038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.387222] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.387356] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.387530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.387887] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-2bcc302f-8be0-4fb5-be3a-348716ec444a taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.388079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.388200] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.388523] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.388661] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bcc302f-8be0-4fb5-be3a-348716ec444a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.667838] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.668028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.668115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.668354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.668475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.668589] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be created. [ 851.685128] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.686085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.686085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.686085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.686085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.686085] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 70c8babe-d476-4541-95df-992602ac6cb6 not found, creating... [ 851.686379] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.686548] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.686663] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.686902] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.687071] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.687377] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.687533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.687648] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.687920] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.688088] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.688245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 70c8babe-d476-4541-95df-992602ac6cb6 is going to be created. [ 851.693726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.693907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.693907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.694099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.694270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.709179] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: UNINITIALIZED for 2s [ 851.713834] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.714157] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.714292] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.714579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.714837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.715085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.890924] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.891214] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.891397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.891763] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.891926] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.892130] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 2bcc302f-8be0-4fb5-be3a-348716ec444a not found, creating... [ 851.892406] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.892565] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.892679] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.892914] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.893063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.893345] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.893496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.893609] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.893845] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.893983] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.894141] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 2bcc302f-8be0-4fb5-be3a-348716ec444a is going to be created. [ 851.918048] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.918297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.918297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.918544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.918798] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.919107] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.154349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 852.154578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.739713] env[65973]: INFO networking_nsxv3.common.synchronization [req-ebd78903-ca0d-4f6c-ac3f-698040b2c6cc req-a2d884b3-7af2-469e-afae-63ddd6c076ec service nova] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_rules [ 852.739713] env[65973]: INFO networking_nsxv3.common.synchronization [req-ebd78903-ca0d-4f6c-ac3f-698040b2c6cc req-a2d884b3-7af2-469e-afae-63ddd6c076ec service nova] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 852.739713] env[65973]: INFO networking_nsxv3.common.synchronization [req-ebd78903-ca0d-4f6c-ac3f-698040b2c6cc req-a2d884b3-7af2-469e-afae-63ddd6c076ec service nova] Enqueued Resource ID: 2bcc302f-8be0-4fb5-be3a-348716ec444a with Priority: HIGHEST for action port [ 852.740248] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_rules [ 852.740381] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 852.741228] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcc302f-8be0-4fb5-be3a-348716ec444a with Priority: HIGHEST for action port [ 852.741578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.741818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.741818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.744783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.744919] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.746623] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.746896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.746896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.747076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.747205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.747305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.747410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.747513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.747607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.747747] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.749996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bcc302f-8be0-4fb5-be3a-348716ec444a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.750197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.750197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.750663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.750663] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bcc302f-8be0-4fb5-be3a-348716ec444a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.941964] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-8fa416d1-a68c-403f-92e8-1df291188966 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 852.941964] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-8fa416d1-a68c-403f-92e8-1df291188966 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 852.941964] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-8fa416d1-a68c-403f-92e8-1df291188966 service nova] Enqueued Resource ID: 70c8babe-d476-4541-95df-992602ac6cb6 with Priority: HIGHEST for action port [ 852.942237] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 852.942389] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 852.945152] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8babe-d476-4541-95df-992602ac6cb6 with Priority: HIGHEST for action port [ 852.945152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.945152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.945152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.945152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.945152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-70c8babe-d476-4541-95df-992602ac6cb6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.945152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.945152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.945152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.945152] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70c8babe-d476-4541-95df-992602ac6cb6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.252779] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.252930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.253169] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.254639] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bcc302f-8be0-4fb5-be3a-348716ec444a with status ACTIVE [ 853.254639] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.254820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.254820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.255615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.255615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255615] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.255615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.255615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.257295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.257295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.257295] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bcc302f-8be0-4fb5-be3a-348716ec444a is going to be updated. [ 853.285671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.285935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.286047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.286304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.286505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.287440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bcc302f-8be0-4fb5-be3a-348716ec444a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.448344] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70c8babe-d476-4541-95df-992602ac6cb6 with status ACTIVE [ 853.448344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.448593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.448593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.448905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.448905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.449043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.449144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.449217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.449509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.449509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.449648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.449799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.449872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.450027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.450101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.450177] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70c8babe-d476-4541-95df-992602ac6cb6 is going to be updated. [ 853.476496] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.476816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.476880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.477123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.477529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.477529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70c8babe-d476-4541-95df-992602ac6cb6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.544491] env[65973]: INFO networking_nsxv3.common.synchronization [req-70aba8c8-5d08-4cb3-91d8-bed0ba8689f0 req-45f69e7d-96f2-443a-b107-b7ffe0152ac4 tempest-ImagesOneServerTestJSON-468614391 tempest-ImagesOneServerTestJSON-468614391-project-member] Enqueued Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 853.544491] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 853.545053] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.547553] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.547553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.547553] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.721155] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 853.721388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.721571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.722204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.722204] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.722383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.722383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.722577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.722673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.722778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.722882] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.725045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.725345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.725582] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.725938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.726041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.726214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.726299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.726574] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.752920] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-972 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.752920] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.753472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.753472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.753588] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.754807] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.754807] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.754807] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.755055] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.755146] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.755251] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.755362] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.755472] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.755583] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.755702] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.755868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.759934] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.777840] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.778032] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.778147] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.778319] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-972" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.778644] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-db026469-88a6-44d5-9023-98fd7f59d631 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.778899] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.779112] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.779313] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.779455] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db026469-88a6-44d5-9023-98fd7f59d631',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.840218] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5f0cda48-a054-4765-b8e4-ab57f326490b None None] Enqueued Resource ID: 5e147a92-6f15-46df-881f-754f37c16694 with Priority: HIGHEST for action port [ 853.844520] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e147a92-6f15-46df-881f-754f37c16694 with Priority: HIGHEST for action port [ 853.844579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e147a92-6f15-46df-881f-754f37c16694 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.844737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e147a92-6f15-46df-881f-754f37c16694" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.844807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e147a92-6f15-46df-881f-754f37c16694" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.845122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e147a92-6f15-46df-881f-754f37c16694" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.845207] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e147a92-6f15-46df-881f-754f37c16694',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.931638] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.931924] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-758" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.932099] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-758" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.932660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-758" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.932977] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.933256] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.933350] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.933541] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.933693] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.933965] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.934185] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.934509] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.934581] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.934729] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.935520] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.935779] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.955824] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.956026] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.956178] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.956468] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-758" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.956867] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.957020] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.957184] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.957481] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.957661] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abe420d-c5dc-4b80-bb84-2a3097b98b4f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.048829] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.048829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.048969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.049141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.049327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.049617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.049732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.049792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.050819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.050819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.050819] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 already deleted. [ 854.050819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.226030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.226212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.236016] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.264093] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.264093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.264093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.264093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.264093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.264093] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be created. [ 854.282249] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.282674] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.283073] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.283255] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.283399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.283580] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port db026469-88a6-44d5-9023-98fd7f59d631 not found, creating... [ 854.283912] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.284079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.284230] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.284450] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.284654] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.284985] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.285339] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.285530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.285812] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.286057] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.286277] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: db026469-88a6-44d5-9023-98fd7f59d631 is going to be created. [ 854.289138] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.289345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.289457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.289680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.289959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.314592] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: UNINITIALIZED for 2s [ 854.321635] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.321925] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.322183] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.322521] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.322785] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.323072] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.347199] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e147a92-6f15-46df-881f-754f37c16694 [ 854.347405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.347405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.347542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.348902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.349056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.349172] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e147a92-6f15-46df-881f-754f37c16694 already deleted. [ 854.349262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e147a92-6f15-46df-881f-754f37c16694" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.460297] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.460730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.460844] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.461174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.461325] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.461481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 1abe420d-c5dc-4b80-bb84-2a3097b98b4f not found, creating... [ 854.461773] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.461935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.462128] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.462329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.462469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.462776] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.462935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.463064] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.463285] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.463416] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.463558] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 1abe420d-c5dc-4b80-bb84-2a3097b98b4f is going to be created. [ 854.508516] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.508774] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.508907] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.509239] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.509499] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.510433] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739540] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.040801] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-00524092-efd9-4c94-8bc1-157213a70ab2 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 855.041205] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-00524092-efd9-4c94-8bc1-157213a70ab2 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 855.041280] env[65973]: INFO networking_nsxv3.common.synchronization [req-744088f7-b69d-4b3c-b1e1-f53be97fe8d0 req-00524092-efd9-4c94-8bc1-157213a70ab2 service nova] Enqueued Resource ID: db026469-88a6-44d5-9023-98fd7f59d631 with Priority: HIGHEST for action port [ 855.042281] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 855.042450] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 855.042621] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db026469-88a6-44d5-9023-98fd7f59d631 with Priority: HIGHEST for action port [ 855.043105] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.043224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.043425] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.043613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.043808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-db026469-88a6-44d5-9023-98fd7f59d631 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.043914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.043977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.044208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.044359] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db026469-88a6-44d5-9023-98fd7f59d631',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.212792] env[65973]: INFO networking_nsxv3.common.synchronization [req-70aba8c8-5d08-4cb3-91d8-bed0ba8689f0 req-5da07a5c-9430-4ac0-a9aa-6e6ba59bdfce service nova] Enqueued Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_rules [ 855.212998] env[65973]: INFO networking_nsxv3.common.synchronization [req-70aba8c8-5d08-4cb3-91d8-bed0ba8689f0 req-5da07a5c-9430-4ac0-a9aa-6e6ba59bdfce service nova] Enqueued Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 855.213188] env[65973]: INFO networking_nsxv3.common.synchronization [req-70aba8c8-5d08-4cb3-91d8-bed0ba8689f0 req-5da07a5c-9430-4ac0-a9aa-6e6ba59bdfce service nova] Enqueued Resource ID: 1abe420d-c5dc-4b80-bb84-2a3097b98b4f with Priority: HIGHEST for action port [ 855.213765] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_rules [ 855.213937] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 855.215246] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1abe420d-c5dc-4b80-bb84-2a3097b98b4f with Priority: HIGHEST for action port [ 855.215246] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.215246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.215246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.216687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.216687] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.217478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.218790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.218790] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.222140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.222140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.222140] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.222140] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.222140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.222140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.222140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.222140] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abe420d-c5dc-4b80-bb84-2a3097b98b4f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.244666] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.244666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.244666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.244666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.244666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.244666] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 855.282796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.282945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.283047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.283451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.283605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.295664] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 855.487869] env[65973]: INFO networking_nsxv3.common.synchronization [None req-6d84a9c3-1b9e-492b-814e-cf7a5c66f157 tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 855.490864] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 855.490864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.490864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.490864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.490864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.490864] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.547619] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db026469-88a6-44d5-9023-98fd7f59d631 with status ACTIVE [ 855.547873] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.548041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.548119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.548313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.548404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.548584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.548693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.548784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.548931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.550082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.550082] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.550082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.550082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.550082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.550446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.550446] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db026469-88a6-44d5-9023-98fd7f59d631 is going to be updated. [ 855.575303] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.575451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.575519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.575742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.575886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.576067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db026469-88a6-44d5-9023-98fd7f59d631" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.614802] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c79f0969-839c-429f-b21a-19b942bc130d tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 855.615365] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 855.615706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.615780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.722883] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.723378] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.723378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.723743] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1abe420d-c5dc-4b80-bb84-2a3097b98b4f with status ACTIVE [ 855.723926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.724052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.724137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.730022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.730022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.730022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.730022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1abe420d-c5dc-4b80-bb84-2a3097b98b4f is going to be updated. [ 855.770251] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.770557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.770557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.770699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.770879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.771127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1abe420d-c5dc-4b80-bb84-2a3097b98b4f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.022757] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.022934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.023016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.023269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.023359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.023415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 already deleted. [ 856.023496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.023652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.023812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.023902] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.225113] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.287542] env[65973]: INFO networking_nsxv3.common.synchronization [req-720279be-f178-4b0b-bd90-a9e89a51d191 req-bd6e61c5-15f0-44d2-9feb-7750ac3cebce tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 856.288235] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 856.288702] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.288879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.288965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.289521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.289742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.289866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.289926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.290127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.290216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.291049] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.326342] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 856.326866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.328782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.328782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.328782] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.543913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.544083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.544235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.544371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.544459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.544554] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 already deleted. [ 856.544637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.701694] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.702041] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.702155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.702476] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.702759] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.702987] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.703701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.703928] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.704251] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.704314] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.704417] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.704519] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.704706] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.705019] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.705019] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.705144] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.724449] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.724672] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.724870] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.725198] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.725592] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-3bf290d0-9d16-4ece-89fc-600f269185ad taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.725838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.725902] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.726282] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.726460] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf290d0-9d16-4ece-89fc-600f269185ad',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.728418] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.728613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.728713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.728941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.729091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.729427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 is going to be created. [ 856.759782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.759782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.759782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.759782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.759782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.779571] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: UNINITIALIZED for 2s [ 856.792611] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.831013] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.831246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.831344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.831625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.831842] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.831974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.832074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.832265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.832382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.832500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.832689] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.832811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.832894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.833093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.833274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.833392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.833473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.833652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.833752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.833868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.833987] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.232732] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.232732] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.232732] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.232732] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.234273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.234273] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 3bf290d0-9d16-4ece-89fc-600f269185ad not found, creating... [ 857.234273] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.234273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.234273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.234273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.234273] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.234273] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.234665] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.234665] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.234665] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.234767] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.235032] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 3bf290d0-9d16-4ece-89fc-600f269185ad is going to be created. [ 857.256145] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.256843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.256931] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.257222] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.257461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.257687] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.294597] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.310023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 857.310311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.310469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.310760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.310924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.311388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.311481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.311646] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.311740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.311797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.311927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.312206] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.312338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.312399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.312512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.312604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.312685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.312773] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.313881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.314057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.314215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.314316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.314400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.314509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.314585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.314659] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.337196] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75299a7e-f943-422d-b243-adb623b647de: rpc.has_security_group_logging(os_id): False [ 857.362263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.362399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.362470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.362701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.362957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.363096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.363158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.363201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.363381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.363439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.363607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.363703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.363757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.363908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.363980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.364179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.364271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.364349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.364486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.364560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.364644] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be created. [ 857.475398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.475652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.475710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.475927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.476133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.489255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: IN_PROGRESS for 2s [ 857.799584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.799584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.799584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.799584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.799584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.799584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 857.818110] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.821159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a575d40f-4efb-403b-a9bf-a1d03f827661: rpc.has_security_group_logging(os_id): False [ 857.845051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.845051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.845051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.845577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.845577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.845951] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.846144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.846246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.846476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.846652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.846934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.847129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.847293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.847518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.847631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847812] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be created. [ 857.850262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.850420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.850511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.850755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.850915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.861975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 857.946096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.946096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.946096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.946096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.946096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.958378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 858.051205] env[65973]: INFO networking_nsxv3.common.synchronization [req-720279be-f178-4b0b-bd90-a9e89a51d191 req-6cc40fe1-c9e3-4d8e-92fa-f054fab5805a service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 858.051205] env[65973]: INFO networking_nsxv3.common.synchronization [req-720279be-f178-4b0b-bd90-a9e89a51d191 req-6cc40fe1-c9e3-4d8e-92fa-f054fab5805a service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 858.051205] env[65973]: INFO networking_nsxv3.common.synchronization [req-720279be-f178-4b0b-bd90-a9e89a51d191 req-6cc40fe1-c9e3-4d8e-92fa-f054fab5805a service nova] Enqueued Resource ID: 3bf290d0-9d16-4ece-89fc-600f269185ad with Priority: HIGHEST for action port [ 858.053889] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 858.054233] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 858.054233] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf290d0-9d16-4ece-89fc-600f269185ad with Priority: HIGHEST for action port [ 858.054641] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.054641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.054789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.056164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.056164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.057328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.057479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.057703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bf290d0-9d16-4ece-89fc-600f269185ad taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.057834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.057989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.058084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.058468] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf290d0-9d16-4ece-89fc-600f269185ad',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.323770] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.561588] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.561588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.561849] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bf290d0-9d16-4ece-89fc-600f269185ad with status ACTIVE [ 858.562171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.562604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.562604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.563310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.563310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.563310] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.563532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.563532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.563890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.563943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.565183] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.565368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.565407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.565602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.565730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.566736] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bf290d0-9d16-4ece-89fc-600f269185ad is going to be updated. [ 858.597390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.597390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.597390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.597390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.597390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.597390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bf290d0-9d16-4ece-89fc-600f269185ad" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.791048] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: SUCCESS [ 858.791425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.791787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.792280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.792532] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.792694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.792844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.793073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.793201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.793323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.793575] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.827104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.827104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.827104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.827104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.827264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.827264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 858.862869] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.863089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.863089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.863294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.863437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.874511] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 858.971419] env[65973]: INFO networking_nsxv3.common.synchronization [req-e53dc7bc-dcba-4bef-8952-c9c06c2dc9e0 req-cd154134-f30b-4844-8586-f03d2847b6cd tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 858.974803] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 858.974803] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.974953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.974953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.975178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.975381] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.975484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.975547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.975721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.975833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.976042] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.296507] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.296507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.296507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.296826] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.296826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.296942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.297035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.297574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.297574] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.297574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.297574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.297786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.297786] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.297858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.297884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.298465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.298465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.298465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.298465] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.479392] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.479933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.479933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.479933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.509886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.509886] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.509886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.509886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.509886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.509886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.509886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 859.512170] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 859.512566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.541355] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.542580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.542580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.542580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.542580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.553228] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 859.557104] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.557104] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.557222] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.557473] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.557752] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.557921] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.559155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.559567] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.560734] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.561115] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.561975] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.561975] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.561975] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.561975] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.561975] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.561975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.581918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.582131] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 859.582296] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.582477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.582813] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.583286] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.583286] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.583467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.583610] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11c8b92-d103-4a22-b9c4-ca322ac21ae0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.801020] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1: rpc.has_security_group_logging(os_id): False [ 859.825264] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.825535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.825599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.825802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.825881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.826119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.826719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.826719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.826719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.826719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.826719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.826992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.826992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.826992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.827134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.827294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.827506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.827506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.827873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.827873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.827873] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 is going to be created. [ 859.873686] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 859.874381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.874381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.874498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.874782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.874864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.874991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.877151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.877151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.877151] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.893401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.893642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.893642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.893898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.894128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.908207] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: IN_PROGRESS for 2s [ 859.991032] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 859.991032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.991032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.991032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.991032] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.089027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.089027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port d11c8b92-d103-4a22-b9c4-ca322ac21ae0 not found, creating... [ 860.089027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.089027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.089542] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.089542] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.089542] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.090066] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.090378] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.090671] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: d11c8b92-d103-4a22-b9c4-ca322ac21ae0 is going to be created. [ 860.116030] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.116030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.116030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.116030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.116030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.116030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.377362] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.493972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.494370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.855396] env[65973]: INFO networking_nsxv3.common.synchronization [req-e53dc7bc-dcba-4bef-8952-c9c06c2dc9e0 req-ef3be2f6-67c4-4ca2-bf7b-e3fa076d6736 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 860.855469] env[65973]: INFO networking_nsxv3.common.synchronization [req-e53dc7bc-dcba-4bef-8952-c9c06c2dc9e0 req-ef3be2f6-67c4-4ca2-bf7b-e3fa076d6736 service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 860.855556] env[65973]: INFO networking_nsxv3.common.synchronization [req-e53dc7bc-dcba-4bef-8952-c9c06c2dc9e0 req-ef3be2f6-67c4-4ca2-bf7b-e3fa076d6736 service nova] Enqueued Resource ID: d11c8b92-d103-4a22-b9c4-ca322ac21ae0 with Priority: HIGHEST for action port [ 860.856084] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 860.856224] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 860.856319] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11c8b92-d103-4a22-b9c4-ca322ac21ae0 with Priority: HIGHEST for action port [ 860.856594] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.856710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.856776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.857019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.857447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.858812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.859842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.860121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.860273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.860367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.860592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.861193] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11c8b92-d103-4a22-b9c4-ca322ac21ae0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.880787] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.889134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 860.889571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.889947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.891027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.891411] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.892393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.892500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.892752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.893123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.893264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.893395] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.364955] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d11c8b92-d103-4a22-b9c4-ca322ac21ae0 with status ACTIVE [ 861.365365] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.365507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.365507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.365793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.365920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.366182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.370027] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.370027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.370027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d11c8b92-d103-4a22-b9c4-ca322ac21ae0 is going to be updated. [ 861.370807] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.370927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.384441] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.384673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.384805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.387623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.387820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.387901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 861.396981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.396981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.397148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.397294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.397968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.397968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.397968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.397968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.397968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.397968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.399494] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.399656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.399721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.399944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.400114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.400303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.400303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.400426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.400534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.400572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.400660] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.406399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.406399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.406399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.406399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.406668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.406668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11c8b92-d103-4a22-b9c4-ca322ac21ae0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.433774] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.433774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.433774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.433774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.433774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.446673] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 861.565852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 861.565852] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 861.565852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.566257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.566257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.566899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.566899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.566899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.566899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.566899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.567157] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.908104] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a575d40f-4efb-403b-a9bf-a1d03f827661: rpc.has_security_group_logging(os_id): False [ 861.931687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.931844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.931930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.932171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.932267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.932628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.932628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.932820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.932820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.932911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.933072] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.933161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.933225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.933380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.933456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.933652] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.933745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.933808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.933953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.937177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.937345] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 861.939190] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: SUCCESS [ 861.939388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.019541] env[65973]: INFO networking_nsxv3.common.synchronization [None req-579f5037-c0aa-4e49-ac1b-9dbf43273acf None None] Enqueued Resource ID: a5f9fa38-53e5-4785-97fc-6a8978bf8382 with Priority: HIGHEST for action port [ 862.020213] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f9fa38-53e5-4785-97fc-6a8978bf8382 with Priority: HIGHEST for action port [ 862.020479] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5f9fa38-53e5-4785-97fc-6a8978bf8382 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.020592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5f9fa38-53e5-4785-97fc-6a8978bf8382" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.020652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5f9fa38-53e5-4785-97fc-6a8978bf8382" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.021522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5f9fa38-53e5-4785-97fc-6a8978bf8382" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.021574] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f9fa38-53e5-4785-97fc-6a8978bf8382',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.075427] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.131102] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.131463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.131463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.131808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.132071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.153375] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 862.523547] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5f9fa38-53e5-4785-97fc-6a8978bf8382 [ 862.523798] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.523910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.524745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.524745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.524745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.524745] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5f9fa38-53e5-4785-97fc-6a8978bf8382 already deleted. [ 862.524745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5f9fa38-53e5-4785-97fc-6a8978bf8382" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.581749] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.086180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.086180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.086180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.086435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.086435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.086633] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 863.117585] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.117725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.117792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.118096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.118235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.128811] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 863.457435] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 863.457435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.457565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.457876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.458106] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.458252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.458355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.458487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.458633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.458678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.458749] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.964400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.964400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.964400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.964400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.964400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.965205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.965205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.965205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.965205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.965205] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.169464] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 864.169711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.169971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.170233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.170324] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.468749] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab67debe-f546-499b-8301-c37179fecdee: rpc.has_security_group_logging(os_id): False [ 864.490806] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.491034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.491034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.491417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.518184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.518184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.518184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.519426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.519426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.519426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.519426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.519426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.519937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.519937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.519937] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 864.607820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.608228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.608228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.608549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.608763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.628768] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 864.673942] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.675130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.675130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.675297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.675667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.675667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.675667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.675817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.675910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.676034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.676122] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.946592] env[65973]: INFO networking_nsxv3.common.synchronization [None req-80e56fe7-98dc-426a-8dd5-8c7f371a7187 None None] Enqueued Resource ID: 210eca90-5c70-44fa-b7cd-669fba80fedb with Priority: HIGHEST for action port [ 864.948249] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210eca90-5c70-44fa-b7cd-669fba80fedb with Priority: HIGHEST for action port [ 864.948459] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-210eca90-5c70-44fa-b7cd-669fba80fedb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.949102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-210eca90-5c70-44fa-b7cd-669fba80fedb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.949102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-210eca90-5c70-44fa-b7cd-669fba80fedb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.949102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-210eca90-5c70-44fa-b7cd-669fba80fedb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.949411] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('210eca90-5c70-44fa-b7cd-669fba80fedb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.141956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 865.141956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.142399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.142399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.142517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.142694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.142791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.142955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.143050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.143140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.143235] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.184048] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.184048] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.184048] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.184048] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.184048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.185333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.185333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.185333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.185333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.185333] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.451829] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 210eca90-5c70-44fa-b7cd-669fba80fedb [ 865.452300] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.452300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.452499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.452803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.452882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.453228] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:210eca90-5c70-44fa-b7cd-669fba80fedb already deleted. [ 865.453228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-210eca90-5c70-44fa-b7cd-669fba80fedb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.646107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.646369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.646482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.646765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.647015] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.647185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.647277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.647476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.647598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.647737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.648426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.648426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.648426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.648426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.648426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.648768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.648768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.648884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.648983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.649219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.649219] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.690043] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a575d40f-4efb-403b-a9bf-a1d03f827661: rpc.has_security_group_logging(os_id): False [ 865.729028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.729028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.729028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.729841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.730263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.730589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.730842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.731189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.732417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.732417] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.732417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.732417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.732417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.732417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.732417] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 865.900578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.900773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.900852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.901762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.902112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.972405] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 866.151803] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 866.171079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.171253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.171310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.171548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.171666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.171904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.172018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.172087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.172254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.172331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.172547] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.172643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.172704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.172847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.172923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.173223] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.173223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.173350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.173421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.173608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.173691] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 866.243201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.243201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.243201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.243201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.243455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.260754] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 866.489020] env[65973]: INFO networking_nsxv3.common.synchronization [req-8c87a182-1cc9-4531-9ed8-29b2bbb2f50d req-dcf08457-fbbc-4409-b5f6-7902887ae7da tempest-ListServerFiltersTestJSON-424073651 tempest-ListServerFiltersTestJSON-424073651-project-member] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 866.489020] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGHEST for action security_group_members [ 866.489419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.489902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.490173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.490718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.491174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.491521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.493432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.493432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.493432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.493432] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.649318] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 866.649556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.995289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.995289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.995289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.995289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.020763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.020763] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.020763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.020763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.020763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.020763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.020763] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be updated. [ 867.058792] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.058792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.058792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.058792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.060516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.073175] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: IN_PROGRESS for 2s [ 867.643802] env[65973]: INFO networking_nsxv3.common.synchronization [req-9c72eea4-332f-4320-b534-eb0785d80aca req-9c79a311-d59b-47ba-8c78-99bf4336acbb tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 867.644663] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 867.645013] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.645231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.645231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.645492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.645651] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.645759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.645824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.645981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.646079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.646175] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.992847] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 867.992847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.050374] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.050374] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.050606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.051069] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.051493] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.051785] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.051984] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.052340] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.052626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.052934] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.054362] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.054545] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.054683] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.054832] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.054980] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.055187] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.078816] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.078990] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.079148] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.079331] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.079627] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.079889] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.080061] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.080427] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.080574] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df523b3b-8c12-4629-b9a5-cf6eaa46f15f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.150014] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.150229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.150306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.150526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.150618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.150821] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.150926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.151019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.151236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.151267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.151374] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 already deleted. [ 868.151425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.279861] env[65973]: INFO networking_nsxv3.common.synchronization [None req-1bc05a77-fbb1-4818-a985-8507e72e42f8 None None] Enqueued Resource ID: e7a76922-310d-475b-9472-f766c2f480f7 with Priority: HIGHEST for action port [ 868.280451] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 868.280824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.281387] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a76922-310d-475b-9472-f766c2f480f7 with Priority: HIGHEST for action port [ 868.281734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7a76922-310d-475b-9472-f766c2f480f7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.281907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7a76922-310d-475b-9472-f766c2f480f7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.281997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7a76922-310d-475b-9472-f766c2f480f7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.282345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7a76922-310d-475b-9472-f766c2f480f7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.282461] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7a76922-310d-475b-9472-f766c2f480f7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.583472] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.583472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.583472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.584264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.584264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.584264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port df523b3b-8c12-4629-b9a5-cf6eaa46f15f not found, creating... [ 868.585265] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.585265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.585265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.585265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.585265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.585509] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.585708] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.585826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.586372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.586372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.586493] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: df523b3b-8c12-4629-b9a5-cf6eaa46f15f is going to be created. [ 868.612637] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.612908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.613052] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.613405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.613663] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.613904] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.784760] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7a76922-310d-475b-9472-f766c2f480f7 [ 868.784760] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.784760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.785175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.785502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.785789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785944] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7a76922-310d-475b-9472-f766c2f480f7 already deleted. [ 868.786201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7a76922-310d-475b-9472-f766c2f480f7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.084675] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 in Status: SUCCESS [ 869.084675] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 deletion is rescheduled due to dependency. [ 869.085027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.417159] env[65973]: INFO networking_nsxv3.common.synchronization [req-9c72eea4-332f-4320-b534-eb0785d80aca req-a79107d6-d0ff-461c-9606-33fa3b01ccac service nova] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 869.417353] env[65973]: INFO networking_nsxv3.common.synchronization [req-9c72eea4-332f-4320-b534-eb0785d80aca req-a79107d6-d0ff-461c-9606-33fa3b01ccac service nova] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 869.417490] env[65973]: INFO networking_nsxv3.common.synchronization [req-9c72eea4-332f-4320-b534-eb0785d80aca req-a79107d6-d0ff-461c-9606-33fa3b01ccac service nova] Enqueued Resource ID: df523b3b-8c12-4629-b9a5-cf6eaa46f15f with Priority: HIGHEST for action port [ 869.418078] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_rules [ 869.418242] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 869.418357] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df523b3b-8c12-4629-b9a5-cf6eaa46f15f with Priority: HIGHEST for action port [ 869.418692] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.418763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.418828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.419782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.419920] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.420843] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.420971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.421907] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.421907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.421907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.423157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.423272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.424117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.424117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.424117] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df523b3b-8c12-4629-b9a5-cf6eaa46f15f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.929025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.929025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.929025] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.929025] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df523b3b-8c12-4629-b9a5-cf6eaa46f15f with status ACTIVE [ 869.929487] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.929487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.929487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.929487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.929744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.929744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.929818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.929863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.930017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.930136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.931513] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.931513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.931513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.931513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.931513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.931513] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df523b3b-8c12-4629-b9a5-cf6eaa46f15f is going to be updated. [ 869.960988] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.960988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.960988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.960988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.961186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.961215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df523b3b-8c12-4629-b9a5-cf6eaa46f15f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.437541] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.703872] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f725ca5e-3079-478c-8798-953f3a32de71 None None] Enqueued Resource ID: a3b814df-8df5-4529-9b48-af0621fedc16 with Priority: HIGHEST for action port [ 870.704725] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b814df-8df5-4529-9b48-af0621fedc16 with Priority: HIGHEST for action port [ 870.705127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b814df-8df5-4529-9b48-af0621fedc16 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.706367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b814df-8df5-4529-9b48-af0621fedc16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.706367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b814df-8df5-4529-9b48-af0621fedc16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.706367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b814df-8df5-4529-9b48-af0621fedc16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.706577] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b814df-8df5-4529-9b48-af0621fedc16',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.946182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.946182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.946182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.946182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.946182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.946182] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 is going to be created. [ 870.978509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.978509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.978509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.978509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.978509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.993579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: UNINITIALIZED for 2s [ 871.210692] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b814df-8df5-4529-9b48-af0621fedc16 [ 871.210907] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.211126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.211206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.211494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.211644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.211784] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b814df-8df5-4529-9b48-af0621fedc16 already deleted. [ 871.211887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b814df-8df5-4529-9b48-af0621fedc16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.465421] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9201bfc-f925-43ca-93da-1d389faa05b2 req-fb57031d-2df1-4ce3-aa27-3aa26b251e35 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 871.465700] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 871.466362] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.466524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.466608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.467287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.467401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.467635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.467635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.469051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.469051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.469051] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.867093] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.867233] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.867355] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.867620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.867960] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.868151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.868310] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.868896] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.869113] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.873021] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.873021] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.873021] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.873021] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.873021] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.873021] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.873021] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.889241] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.889885] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.890119] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.890308] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.890829] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-ee09069f-6d97-4d84-86ef-a20eb17ae92c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.890829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.891240] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.891285] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.891407] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee09069f-6d97-4d84-86ef-a20eb17ae92c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.970821] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.971206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.971206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.971293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.992800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.993106] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.993230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.993310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.993515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.994133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.994133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 872.026021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.026021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.026021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.026021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.026021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.035618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 872.394475] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.394694] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.394877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.395122] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.395429] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.395429] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port ee09069f-6d97-4d84-86ef-a20eb17ae92c not found, creating... [ 872.395691] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.395860] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.395971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.396226] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.396893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.396893] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.397192] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.397347] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.397653] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.397900] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.398069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: ee09069f-6d97-4d84-86ef-a20eb17ae92c is going to be created. [ 872.421546] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.421722] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.421884] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.422218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.422486] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.422727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.007640] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: SUCCESS [ 873.008081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.008081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.008421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.008676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.008979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.008979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.009183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.009308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.009432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.009649] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.205951] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9201bfc-f925-43ca-93da-1d389faa05b2 req-21552c2a-901e-4b9c-af77-e06db58afaf5 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 873.206190] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9201bfc-f925-43ca-93da-1d389faa05b2 req-21552c2a-901e-4b9c-af77-e06db58afaf5 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 873.206358] env[65973]: INFO networking_nsxv3.common.synchronization [req-d9201bfc-f925-43ca-93da-1d389faa05b2 req-21552c2a-901e-4b9c-af77-e06db58afaf5 service nova] Enqueued Resource ID: ee09069f-6d97-4d84-86ef-a20eb17ae92c with Priority: HIGHEST for action port [ 873.206944] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 873.207285] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 873.207448] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee09069f-6d97-4d84-86ef-a20eb17ae92c with Priority: HIGHEST for action port [ 873.207864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.208017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.208124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.208396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.208528] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.209546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.209717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.210062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee09069f-6d97-4d84-86ef-a20eb17ae92c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.210233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.210405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.210669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.210873] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee09069f-6d97-4d84-86ef-a20eb17ae92c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.489570] env[65973]: INFO networking_nsxv3.common.synchronization [req-daa86d5d-d71f-41e4-9afb-02db365dd60c req-ffdeb46e-2339-4bfd-a8d9-78acd67d040f tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 873.489570] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 873.489570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.489570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.489570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.489570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.489570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.490943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.490943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.490943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.490943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.490943] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.512584] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.716194] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.716375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.716688] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee09069f-6d97-4d84-86ef-a20eb17ae92c with status ACTIVE [ 873.716751] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.716935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.717039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.717475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.717589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.717764] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.718259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.718259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.718259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.719688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.719688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.719688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.719688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.719688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.719688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.720125] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee09069f-6d97-4d84-86ef-a20eb17ae92c is going to be updated. [ 873.747836] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.749960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.749960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.749960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.749960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.749960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee09069f-6d97-4d84-86ef-a20eb17ae92c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.902476] env[65973]: INFO networking_nsxv3.common.synchronization [req-daa86d5d-d71f-41e4-9afb-02db365dd60c req-bdfeed60-84ba-4fa4-9704-1c3121e30c8d tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 873.903874] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 873.904427] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.904594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.996791] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.015080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88b4ac05-7dae-4c69-af3f-5a58ae902308: rpc.has_security_group_logging(os_id): False [ 874.035756] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.036031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.036031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.036179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.036268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.036552] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.036650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.036719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.036911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.036993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.037100] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 is going to be created. [ 874.055038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 874.055246] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 874.055354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.055527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.055748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.055935] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.056072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.056138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.056311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.056382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.056482] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.113838] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.113990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.114774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.114774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.114774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.131532] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: IN_PROGRESS for 2s [ 874.264873] env[65973]: INFO networking_nsxv3.common.synchronization [req-daa86d5d-d71f-41e4-9afb-02db365dd60c req-38171289-adf6-416c-b141-e848afebb6f8 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 874.265624] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 874.265877] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.265979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.500583] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.559236] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.003868] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.004594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.004594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.004594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.004594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.004594] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 875.041967] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.042305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.042305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.042530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.042567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.056269] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 875.063666] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.567486] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.567729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.567729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.567989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.568120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.568223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 875.605674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.605851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.605939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.606189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.606379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.619442] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 876.144936] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: SUCCESS [ 876.144936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.068900] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 877.069167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.069349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.069578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.069777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.069929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.069993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.070174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.070257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.070347] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.572920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.573267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.573267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.573501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.573624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.573851] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.573975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.574080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.574276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.574362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.574469] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 877.605426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.605604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.605663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.605892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.606059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.615984] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 877.628220] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 877.628517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.628728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.628998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.629224] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.629347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.629410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.629569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.629645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.629727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.629815] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.135618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.135618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.135618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.135618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.136215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.136215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.136215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.136215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.136215] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.643395] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 878.667972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.671080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.671080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.671080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.671612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.671612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.671612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.671612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.671744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.671849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.672137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.672622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.672713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.672816] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 878.764669] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.764920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.764920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.765848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.765848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.784552] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 878.791297] env[65973]: INFO networking_nsxv3.common.synchronization [req-39dd6435-185c-4e06-af8c-e7c2a0652852 req-55c1fff7-1095-4aec-b73e-aee1c8bdcb0a tempest-ServersV294TestFqdnHostnames-665253038 tempest-ServersV294TestFqdnHostnames-665253038-project-member] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 878.791695] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 878.792209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.792543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.792780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.793197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.793626] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.793845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.794263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.794482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.794695] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.242453] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.242894] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-745" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.242894] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-745" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.243231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-745" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.243508] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.243681] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.243815] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.244293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.244482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.244736] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.244839] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.244968] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.245099] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.245213] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.247044] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.247044] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.270738] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.270902] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.271056] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.271294] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-745" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.271603] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-1691509c-b16b-4533-b81b-0a5ec8904d09 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.271719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.272052] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.272202] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.272337] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1691509c-b16b-4533-b81b-0a5ec8904d09',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.297374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.297667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.297667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.297861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.297973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.298197] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.298303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.298369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.298527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.299038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.299038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 already deleted. [ 879.299038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.628951] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 879.629695] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 deletion is rescheduled due to dependency. [ 879.629695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.629695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.629945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.630215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.630305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.630377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.630595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.630711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.630817] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.776440] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.776837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.776837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.776993] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.777155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.777450] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 1691509c-b16b-4533-b81b-0a5ec8904d09 not found, creating... [ 879.777723] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.777898] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.778021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.778257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.778391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.778672] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.778827] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.778939] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.779167] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.779346] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.779500] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 1691509c-b16b-4533-b81b-0a5ec8904d09 is going to be created. [ 879.801478] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.801770] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.801855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.802229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.802498] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.802750] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.133443] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.133614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.133686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.133928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.134053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.134273] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.134381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.134568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.134659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.134768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.134885] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 880.164147] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.164285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.164357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.164680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.164818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.177412] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 880.547582] env[65973]: INFO networking_nsxv3.common.synchronization [req-39dd6435-185c-4e06-af8c-e7c2a0652852 req-ce350562-6f70-43ac-b3c4-5596ccdb614d service nova] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 880.547717] env[65973]: INFO networking_nsxv3.common.synchronization [req-39dd6435-185c-4e06-af8c-e7c2a0652852 req-ce350562-6f70-43ac-b3c4-5596ccdb614d service nova] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 880.547881] env[65973]: INFO networking_nsxv3.common.synchronization [req-39dd6435-185c-4e06-af8c-e7c2a0652852 req-ce350562-6f70-43ac-b3c4-5596ccdb614d service nova] Enqueued Resource ID: 1691509c-b16b-4533-b81b-0a5ec8904d09 with Priority: HIGHEST for action port [ 880.548675] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_rules [ 880.549053] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 880.549053] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1691509c-b16b-4533-b81b-0a5ec8904d09 with Priority: HIGHEST for action port [ 880.549221] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.549343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.549443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.549608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.549690] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.550662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.550778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.551780] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.551780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.552142] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.553106] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1691509c-b16b-4533-b81b-0a5ec8904d09 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.553217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.553259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.553429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.553501] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1691509c-b16b-4533-b81b-0a5ec8904d09',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.828751] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 880.829147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.055401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.055539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.055782] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.058562] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1691509c-b16b-4533-b81b-0a5ec8904d09 with status ACTIVE [ 881.059146] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.059330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.059404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.059703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.059827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.060084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.060198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.060306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.060570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.060570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.060764] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.060858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.060978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.061112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.061175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.061261] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1691509c-b16b-4533-b81b-0a5ec8904d09 is going to be updated. [ 881.095670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.095845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.095905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.096149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.096293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.096461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1691509c-b16b-4533-b81b-0a5ec8904d09" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.558149] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.065023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.065023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.065023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.065023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.065023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.065023] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 is going to be created. [ 882.090979] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.091224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.091289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.091479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.091672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.103287] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: UNINITIALIZED for 2s [ 882.190402] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 882.190541] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 deletion is rescheduled due to dependency. [ 882.190621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.885326] env[65973]: INFO networking_nsxv3.common.synchronization [req-2573692f-1093-40c9-a8a9-7402ec7927bd req-13da327e-bc4a-45c3-a8c1-345c84f34477 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 882.885717] env[65973]: INFO networking_nsxv3.common.synchronization [req-2573692f-1093-40c9-a8a9-7402ec7927bd req-13da327e-bc4a-45c3-a8c1-345c84f34477 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 882.885969] env[65973]: INFO networking_nsxv3.common.synchronization [req-2573692f-1093-40c9-a8a9-7402ec7927bd req-13da327e-bc4a-45c3-a8c1-345c84f34477 tempest-SecurityGroupsTestJSON-1855046042 tempest-SecurityGroupsTestJSON-1855046042-project-member] Enqueued Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 882.887757] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGHEST for action security_group_members [ 882.888852] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGHEST for action security_group_members [ 882.889101] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 with Priority: HIGHEST for action security_group_members [ 882.890840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.891063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.891063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.891371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.891918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.891918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.891918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.892661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.892661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.892661] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.895296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.895296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.895296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.895844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.895844] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.896600] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d1f177-ec77-4d3a-bc27-48a23b238428 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.896600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.896812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.896812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.897393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.898876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.898876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.898876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.898876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.898876] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d1f177-ec77-4d3a-bc27-48a23b238428',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.899608] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf35400c-408e-47e3-99ca-9342b57a4264 req-843d7fc3-189e-434a-b8ab-f8f36f578f4b tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 882.900804] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 882.901218] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.902244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.902244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.902244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.902244] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.902244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.902244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.902512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.902607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.902930] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.401311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.401311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.401311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.401689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.402681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.403022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.403135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.405095] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.425414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.425688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.425809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.425875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.426098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.426178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.426264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 is going to be updated. [ 883.427553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.427714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.447582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.447895] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.448065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.448139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.448348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.448436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.448742] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be updated. [ 883.449842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.449842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.449842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.450090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.450153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.450501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.450501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.450501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.450501] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be updated. [ 883.479081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.479081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.479304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.479484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.480162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.496176] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: IN_PROGRESS for 2s [ 883.500257] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.500257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.500257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.500687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.500687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.504556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.504955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.504955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.505708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.505708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.516585] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: IN_PROGRESS for 2s [ 883.517489] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: IN_PROGRESS for 2s [ 883.739742] env[65973]: INFO networking_nsxv3.common.synchronization [req-81347475-d76f-492f-a7ef-904ef8a2275e req-46fc88aa-dd8e-4918-bff0-66d2553b0395 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 883.740510] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 883.740933] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.741265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.741265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.741485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.741689] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.741823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.741910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.742134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.742253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.742383] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.907661] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.114890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: SUCCESS [ 884.115485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.115485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.115619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.115712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.115824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.115887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.117249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.117249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.117249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.117249] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.244655] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.410385] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.411178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.412027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.412124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.412264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.412422] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 884.445723] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.445723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.445723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.445925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.446012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.455830] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 884.618456] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.747892] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.121452] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 364ddebc-6f46-4ac6-be33-ab246d291a56: rpc.has_security_group_logging(os_id): False [ 885.143220] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.143412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.143534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.143743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.143862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.144157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.144268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.144338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.144505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.144584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.144674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 is going to be created. [ 885.214296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.214544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.214622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.214969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.215160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.228870] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: IN_PROGRESS for 2s [ 885.251386] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.251540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.251606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.251834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.251924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.252036] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 885.290533] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.290533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.290533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.290533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.290533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.300154] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 885.508487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 in Status: SUCCESS [ 885.508755] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d1f177-ec77-4d3a-bc27-48a23b238428 deletion is rescheduled due to dependency. [ 885.508870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d1f177-ec77-4d3a-bc27-48a23b238428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.527963] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf5934e-9748-40f8-8554-93454e399b70 in Status: SUCCESS [ 885.528528] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf5934e-9748-40f8-8554-93454e399b70 deletion is rescheduled due to dependency. [ 885.528528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.529261] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 in Status: SUCCESS [ 885.529450] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 deletion is rescheduled due to dependency. [ 885.529580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.747688] env[65973]: INFO networking_nsxv3.common.synchronization [req-13dccfa4-2420-4bd5-ac5a-3e2b88f5bf21 req-6c62ff73-26e3-472e-96ae-e3f66ab00d40 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 885.748543] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 885.748972] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.749131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.749194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.749444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.749620] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.749765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.749821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.750038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.750189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.750300] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.253241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.253430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.253551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.253780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.253902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.254151] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.254253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.254334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.254540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.254625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.254718] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be updated. [ 886.286287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.286465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.286504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.286723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.286870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.298413] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: IN_PROGRESS for 2s [ 886.466224] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 886.466488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.247088] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: SUCCESS [ 887.247490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.311915] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 887.312222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.362717] env[65973]: INFO networking_nsxv3.common.synchronization [req-b9ae168c-611e-4a93-9148-60ec908f4e3c req-9bc89a56-83cb-4647-9e00-44315a3a8366 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 887.363378] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 887.363751] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.363875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.363944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.364702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.364954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.365115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.365181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.365364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.365465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.365604] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.802932] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.803222] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.803353] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.803705] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.803967] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.804221] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.804375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.804739] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.804970] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.805318] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.805506] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.805668] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.805821] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.805939] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.806084] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.806282] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.835129] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.835336] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.835474] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.835695] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.836031] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-9b0a4a60-e3b0-4524-b590-96f631c59f36 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.836242] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.836362] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.836762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.837478] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0a4a60-e3b0-4524-b590-96f631c59f36',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.870333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.870333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.870333] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 already deleted. [ 887.870333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.308677] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 888.309038] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de deletion is rescheduled due to dependency. [ 888.309038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.339579] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.339874] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.340090] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.340454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.340620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.340808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 9b0a4a60-e3b0-4524-b590-96f631c59f36 not found, creating... [ 888.341315] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.341530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.341750] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.342058] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.342246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.342881] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.342881] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.342996] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.343140] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.343276] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.343415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 9b0a4a60-e3b0-4524-b590-96f631c59f36 is going to be created. [ 888.366741] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.367084] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.367303] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.368030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.368030] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.368264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.053630] env[65973]: INFO networking_nsxv3.common.synchronization [None req-496f545f-a203-4967-9460-629a309fa869 tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: fe057f2f-8a28-40de-8a38-d0b175feec99 with Priority: HIGHEST for action security_group_rules [ 889.057016] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe057f2f-8a28-40de-8a38-d0b175feec99 with Priority: HIGHEST for action security_group_rules [ 889.057016] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe057f2f-8a28-40de-8a38-d0b175feec99 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.057016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.057016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.057016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.057016] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe057f2f-8a28-40de-8a38-d0b175feec99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.077613] env[65973]: INFO networking_nsxv3.common.synchronization [req-b9ae168c-611e-4a93-9148-60ec908f4e3c req-10351a88-78df-4249-86a9-bc8b9b86fb29 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 889.077805] env[65973]: INFO networking_nsxv3.common.synchronization [req-b9ae168c-611e-4a93-9148-60ec908f4e3c req-10351a88-78df-4249-86a9-bc8b9b86fb29 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 889.077919] env[65973]: INFO networking_nsxv3.common.synchronization [req-b9ae168c-611e-4a93-9148-60ec908f4e3c req-10351a88-78df-4249-86a9-bc8b9b86fb29 service nova] Enqueued Resource ID: 9b0a4a60-e3b0-4524-b590-96f631c59f36 with Priority: HIGHEST for action port [ 889.081899] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 889.082100] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 889.082223] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0a4a60-e3b0-4524-b590-96f631c59f36 with Priority: HIGHEST for action port [ 889.082932] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.083162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.083268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.083553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.083641] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.084559] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.084677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.084739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.084911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.085809] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.085928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.085994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.086180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.086290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.086438] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.087260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b0a4a60-e3b0-4524-b590-96f631c59f36 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.087372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.087437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.087596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.087672] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0a4a60-e3b0-4524-b590-96f631c59f36',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.175988] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5503a53d-84da-4482-b59b-b216ef91929c tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: fe057f2f-8a28-40de-8a38-d0b175feec99 with Priority: HIGHEST for action security_group_rules [ 889.175988] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe057f2f-8a28-40de-8a38-d0b175feec99 with Priority: HIGHEST for action security_group_rules [ 889.175988] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe057f2f-8a28-40de-8a38-d0b175feec99 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.175988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.581571] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.581571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.581970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.581970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.581970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.582091] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe057f2f-8a28-40de-8a38-d0b175feec99 already deleted. [ 889.582208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.582410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.582588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.582674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe057f2f-8a28-40de-8a38-d0b175feec99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.591736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.591736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.592846] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.593852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b0a4a60-e3b0-4524-b590-96f631c59f36 with status ACTIVE [ 889.594045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.594166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.594228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.594428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.594506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.594680] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.594775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.594834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.594996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.595080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.595276] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.595363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.595420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.595556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.595626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.595703] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b0a4a60-e3b0-4524-b590-96f631c59f36 is going to be updated. [ 889.621938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.622134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.622322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.622585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.622738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.622907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b0a4a60-e3b0-4524-b590-96f631c59f36" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.098997] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.108998] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.109335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.109431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.109724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.109888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.110024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe057f2f-8a28-40de-8a38-d0b175feec99 already deleted. [ 890.110124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe057f2f-8a28-40de-8a38-d0b175feec99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.602529] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.602837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.602837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.602984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.603106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.603212] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be created. [ 890.629133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.629358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.629358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.629562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.629726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.641620] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: UNINITIALIZED for 2s [ 892.268223] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ca73d53-bc78-48be-bf3a-6b27895f5fdf req-a2dc2177-7418-4644-bb3e-6c0d698f4497 tempest-ServerActionsV293TestJSON-334095518 tempest-ServerActionsV293TestJSON-334095518-project-member] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 892.268809] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 892.269222] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.269362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.269418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.269684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.269890] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.270012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.270052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.270251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.270303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.270395] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.634982] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.635205] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-108" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.635325] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-108" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.635677] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-108" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.635944] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.636117] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.636231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.636453] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.636593] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.636825] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.636939] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.637058] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.637485] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.637619] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.637727] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.637926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.650482] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 892.650780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.651037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.651337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.651884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.652065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.652140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.652337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.652436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.652524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.652617] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.659862] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.660117] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.660271] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.660473] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-108" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.660794] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-5cff986d-f7a7-4b5b-804b-927e31aa43e6 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.660971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.661142] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.661484] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.661638] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cff986d-f7a7-4b5b-804b-927e31aa43e6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.773046] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.773336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.773336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.773642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.773954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.773954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.774134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.774913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.774913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.774913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.774913] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b already deleted. [ 892.774913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.155317] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.155537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.155537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.155752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.155929] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.156044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.156099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.156260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.156348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.156438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.156587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.156680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.156734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.156890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.157039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.157133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.157193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.157334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.157409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.157487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.157578] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.163932] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.164146] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.164274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.164522] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.164659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.164805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 5cff986d-f7a7-4b5b-804b-927e31aa43e6 not found, creating... [ 893.165087] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.165295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.165475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.165713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.165852] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.166154] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.166318] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.166433] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.166641] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.166773] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.166911] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 5cff986d-f7a7-4b5b-804b-927e31aa43e6 is going to be created. [ 893.196536] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.196803] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.196942] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.197301] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.197622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.197936] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.660193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 893.681859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.682095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.682217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.682585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.683247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.685299] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.685299] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.685299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.686418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.688028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.688028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.688177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.689194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.689194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.689194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.689194] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be created. [ 893.757687] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.757687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.757687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.757687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.757687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.777805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ca73d53-bc78-48be-bf3a-6b27895f5fdf req-fcc68eb3-5e3b-416b-aa7b-6b42e34cd3a8 service nova] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ca73d53-bc78-48be-bf3a-6b27895f5fdf req-fcc68eb3-5e3b-416b-aa7b-6b42e34cd3a8 service nova] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [req-0ca73d53-bc78-48be-bf3a-6b27895f5fdf req-fcc68eb3-5e3b-416b-aa7b-6b42e34cd3a8 service nova] Enqueued Resource ID: 5cff986d-f7a7-4b5b-804b-927e31aa43e6 with Priority: HIGHEST for action port [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_rules [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 893.949853] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cff986d-f7a7-4b5b-804b-927e31aa43e6 with Priority: HIGHEST for action port [ 893.950394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.950461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.950496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.950709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.950774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.953076] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.953250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.953358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.953698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.953929] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.954449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.954449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.954449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.954594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.954676] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.956012] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cff986d-f7a7-4b5b-804b-927e31aa43e6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.956772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.956772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.956772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.956772] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cff986d-f7a7-4b5b-804b-927e31aa43e6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.295309] env[65973]: INFO networking_nsxv3.common.synchronization [req-374499e1-6e3b-47e6-b6cf-34ffdd6cc3b2 req-d48e528c-288c-414e-915b-35e1121ef536 tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 894.295915] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 894.296316] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.296394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.296472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.296763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.296919] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.297042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.297119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.297408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.297408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.297497] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.454910] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.455077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.456536] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.458880] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cff986d-f7a7-4b5b-804b-927e31aa43e6 with status ACTIVE [ 894.459191] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.459340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.459422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.459666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.459778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.460014] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.461081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.461248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.461469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.461592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.461825] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.461968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.462141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.462454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.462544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.462662] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cff986d-f7a7-4b5b-804b-927e31aa43e6 is going to be updated. [ 894.497587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.497798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.497838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.498169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.498570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.498570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cff986d-f7a7-4b5b-804b-927e31aa43e6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.692694] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.693095] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.693296] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.693558] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.693827] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.693978] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.694098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.694315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.694464] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.694668] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.694841] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.694950] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.695081] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.695188] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.697710] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.697710] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.715872] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.716082] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 894.716223] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.716420] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.716779] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-8dd07a90-c3da-47d1-82a5-85367447eb5e taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.717046] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.717237] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.717640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.717832] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd07a90-c3da-47d1-82a5-85367447eb5e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.800445] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.800787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.800787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.801090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.801199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.801432] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.801637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.801727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.802021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.802144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.802249] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 already deleted. [ 894.802360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.960117] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.224380] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.224610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.224610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.224811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.224967] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.225138] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 8dd07a90-c3da-47d1-82a5-85367447eb5e not found, creating... [ 895.225524] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.225702] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.225809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.226051] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.226214] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.226478] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.226644] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.226760] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.226971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.227116] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.227277] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e is going to be created. [ 895.252499] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.252499] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.252499] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.252827] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.253125] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.253383] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.463023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.463320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.463457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.463816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.463993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.464194] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b is going to be created. [ 895.495044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.495261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.495326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.495712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.495844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.509842] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: UNINITIALIZED for 2s [ 895.797765] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 895.798097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.993723] env[65973]: INFO networking_nsxv3.common.synchronization [req-374499e1-6e3b-47e6-b6cf-34ffdd6cc3b2 req-c102c914-6e41-4e76-b80e-a834c5ce212e service nova] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 895.993723] env[65973]: INFO networking_nsxv3.common.synchronization [req-374499e1-6e3b-47e6-b6cf-34ffdd6cc3b2 req-c102c914-6e41-4e76-b80e-a834c5ce212e service nova] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 895.993723] env[65973]: INFO networking_nsxv3.common.synchronization [req-374499e1-6e3b-47e6-b6cf-34ffdd6cc3b2 req-c102c914-6e41-4e76-b80e-a834c5ce212e service nova] Enqueued Resource ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e with Priority: HIGHEST for action port [ 895.994411] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 895.994452] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 895.994544] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e with Priority: HIGHEST for action port [ 895.994818] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.994964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.995057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.998331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.998331] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.998843] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.998977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.999084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.999326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.000065] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.000183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.000250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.000424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.000514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.000607] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.001923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd07a90-c3da-47d1-82a5-85367447eb5e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.002978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.003117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.003294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.003383] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd07a90-c3da-47d1-82a5-85367447eb5e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.506197] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.508040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.508369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.508544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dd07a90-c3da-47d1-82a5-85367447eb5e with status ACTIVE [ 896.508883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.510154] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.510154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.510591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.510591] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.510802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.510907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.511129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.511249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.511360] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e is going to be updated. [ 896.538483] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.538837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.539046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.539624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.539812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.540101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.014597] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.518306] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.518502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.518589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.518884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.519020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.519182] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be created. [ 897.521120] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: SUCCESS [ 897.521343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.521516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.521717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.521916] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.522046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.522110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.522271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.522350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.522439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.522531] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.552023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.552023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.552023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.552023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.552023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.563147] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: UNINITIALIZED for 2s [ 898.026827] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.528301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3639d272-10a3-4e14-b0d6-0d00cd61092b: rpc.has_security_group_logging(os_id): False [ 898.547679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.547813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.547935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.548192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.548341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.548597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.548701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.548766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.548927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.549013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.549104] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b is going to be created. [ 898.618028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.618028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.618028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.618028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.618028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.632475] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: IN_PROGRESS for 2s [ 899.047839] env[65973]: INFO networking_nsxv3.common.synchronization [req-defe24d1-3df2-4c79-8a23-2c6ae9cbd80b req-90a2e9ad-2421-48a4-8b05-455e2400048e tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 899.048427] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 899.048747] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.049048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.049048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.049194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.049313] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.049412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.049472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.049631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.049719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.049811] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.460884] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.461245] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.461400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.461682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.461946] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.462128] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.462325] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.462588] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.462664] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.462815] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.462925] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.463059] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.463182] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.463294] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.463402] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.463551] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.484909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.485184] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.485459] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.485506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-702" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.485872] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.486148] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.486372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.486778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.486923] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.554954] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.554954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.554954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.554954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.575700] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: SUCCESS [ 899.576366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.576366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.576518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.576752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.576909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.576993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.577873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.577873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.577873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.577873] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.579734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.579971] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.580180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.580230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.580424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.580506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.580598] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 899.624441] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.624600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.624667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.624981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.625191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.640154] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 899.992155] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.992155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.992155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.992564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.992740] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.992900] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 not found, creating... [ 899.993196] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.993499] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.993603] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.993827] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.993961] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.994345] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.994523] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.994638] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.994877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.995053] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.995208] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 is going to be created. [ 900.019982] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.020318] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.020458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.020724] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.020949] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.021217] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.082639] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.587443] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8914f4ea-4ed1-4101-ab21-2b15a1da5534: rpc.has_security_group_logging(os_id): False [ 900.613072] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.613220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.613288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.613511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.613603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.613842] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.613981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.614036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.614171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.614249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.614337] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be created. [ 900.644721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: SUCCESS [ 900.644767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.685260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.685437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.685437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.689035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.689035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.697934] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: IN_PROGRESS for 2s [ 900.781589] env[65973]: INFO networking_nsxv3.common.synchronization [req-defe24d1-3df2-4c79-8a23-2c6ae9cbd80b req-2e7f2580-032b-4bae-bea0-6c982fe2d0f9 service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 900.781589] env[65973]: INFO networking_nsxv3.common.synchronization [req-defe24d1-3df2-4c79-8a23-2c6ae9cbd80b req-2e7f2580-032b-4bae-bea0-6c982fe2d0f9 service nova] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 900.781589] env[65973]: INFO networking_nsxv3.common.synchronization [req-defe24d1-3df2-4c79-8a23-2c6ae9cbd80b req-2e7f2580-032b-4bae-bea0-6c982fe2d0f9 service nova] Enqueued Resource ID: 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 with Priority: HIGHEST for action port [ 900.782772] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_rules [ 900.782818] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 900.782961] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 with Priority: HIGHEST for action port [ 900.783454] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.783573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.783639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.783848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.783927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.784911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.785027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.785282] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.785364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.785441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.785661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.785745] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.293038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.293038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 with status ACTIVE [ 901.293038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.293038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.293038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.293038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.293914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.293914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.293914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.293914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.293914] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3 is going to be updated. [ 901.320928] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.321819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.321819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.322590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.322590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.322590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6dfeb3-cddf-49ab-8187-fb4c0b6724c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.650484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 901.650484] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e deletion is rescheduled due to dependency. [ 901.650621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.650712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.650946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.651159] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.651307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.651378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.651556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.651608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.651697] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.786508] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf734e5d-b777-482f-abad-73106f02836f req-84c3a276-681f-4c2d-a17d-c2dc2f7c3d76 tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 901.787186] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 901.787473] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.788132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.788237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.788472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.788656] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.788762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.788838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.789199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.789199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.789365] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.153105] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-79 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.153105] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.153105] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.153105] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.153105] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.153585] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.153843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.154196] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.154474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.154983] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.160173] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.160173] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.160173] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.160173] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.160173] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.160173] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.160173] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.178874] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.179055] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.179584] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.180778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.181213] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.181417] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.181540] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.181874] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.182322] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.292064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.293968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.294301] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.294699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.294876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.295144] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.295305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.295405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.295589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.295695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.295834] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 already deleted. [ 902.295947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.362622] env[65973]: INFO networking_nsxv3.common.synchronization [req-af2092f8-ae35-4616-a1cb-3d2c3a8bc788 req-c5d730bb-c8b1-4196-a9dc-349f00d0c78d tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 902.363127] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 902.363272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.363478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.363478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.364176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.364176] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.364176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.364176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.364176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.364459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.364459] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.662636] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.685856] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.686166] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.686281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.686600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.686806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.686972] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea not found, creating... [ 902.687284] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.687490] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.687591] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.687845] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.688049] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.688402] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.688560] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.688670] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.688990] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.689143] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.689315] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea is going to be created. [ 902.716192] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: SUCCESS [ 902.716457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.719156] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.719400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.719568] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.719998] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.720316] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.720580] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.867393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.867393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.867495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.867790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.868087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.868873] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.868873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.868873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.869147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.869147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.869242] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 902.925581] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.925739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.925836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.926018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.926212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.943069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 903.166694] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.167062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.167062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.167181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.167276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.167381] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 903.200373] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.200562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.200603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.200847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.201018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.212160] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf734e5d-b777-482f-abad-73106f02836f req-58cb58cf-8867-4d05-85c0-0b444936421a service nova] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_rules [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf734e5d-b777-482f-abad-73106f02836f req-58cb58cf-8867-4d05-85c0-0b444936421a service nova] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf734e5d-b777-482f-abad-73106f02836f req-58cb58cf-8867-4d05-85c0-0b444936421a service nova] Enqueued Resource ID: ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea with Priority: HIGHEST for action port [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_rules [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 903.484399] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea with Priority: HIGHEST for action port [ 903.484399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.484399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.484399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.484399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.484399] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.485467] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.486255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.486344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.486617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.486856] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.487028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.487113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.487314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.487720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.487868] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.489054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.489221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.489645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.489871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.489995] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.992839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.993018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.993863] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.994069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea with status ACTIVE [ 903.994247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.994351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.994415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.994615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.994706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.994854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.995244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.995244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.995244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.995244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.995476] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.995476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.995592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.995661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.995725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.995803] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea is going to be updated. [ 904.018473] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.018610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.018690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.018896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.019066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.019262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea38b1c9-c015-4a44-9a6c-9c1d2ba9f0ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.417434] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-f8c4a9a2-b4d1-4989-a063-a34f9196f262 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 904.418026] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 904.418333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.418457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.418524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.418730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.418878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.419275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.419275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.420512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.420647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.420774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.498129] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.801079] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.801449] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.801653] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.802223] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.802648] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.803281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.805636] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.805636] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.805636] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.805636] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.805636] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.805636] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.805636] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.805922] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.805922] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.806045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.832738] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.832738] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.832940] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.833075] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.833467] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-95b79c71-1064-4339-a415-9b8c3a77af2f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.833683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.833825] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.834804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.834804] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b79c71-1064-4339-a415-9b8c3a77af2f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.925180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.925401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.925473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.925678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.955621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.955999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.956195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.956290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.956807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.956971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.957123] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 904.958982] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 904.959158] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 904.959257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.000724] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.000724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.001129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.001129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.001245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.002488] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.002622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.002692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.002893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.002978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.003111] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be created. [ 905.018466] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 905.034562] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.034727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.034798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.035040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.035274] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.048939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: UNINITIALIZED for 2s [ 905.227112] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 905.227555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.227796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.228191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.228499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.229019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.229019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.229019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.229231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.229231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.229340] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.337106] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.337383] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.337508] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.337829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.338017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.338197] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 95b79c71-1064-4339-a415-9b8c3a77af2f not found, creating... [ 905.338526] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.338725] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.338937] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.339265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.339478] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.339855] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.340118] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.340232] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.340529] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.340721] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.340780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 95b79c71-1064-4339-a415-9b8c3a77af2f is going to be created. [ 905.364447] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.364797] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.364965] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.365371] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.365649] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.365996] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.733189] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.733189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.733189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.733189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.733864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.733864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.733864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.733985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.734068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.734254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.734878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.734878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.734878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.735093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.735339] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.735405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.735500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.735711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.735817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.735929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.736111] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.122816] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-e18777db-02b4-459c-b150-3862f4637e5a service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 906.123021] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-e18777db-02b4-459c-b150-3862f4637e5a service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 906.123195] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-e18777db-02b4-459c-b150-3862f4637e5a service nova] Enqueued Resource ID: 95b79c71-1064-4339-a415-9b8c3a77af2f with Priority: HIGHEST for action port [ 906.123707] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 906.123844] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 906.123942] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b79c71-1064-4339-a415-9b8c3a77af2f with Priority: HIGHEST for action port [ 906.124397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.124522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.124591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.124799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.124878] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.126216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.126216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.126216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b79c71-1064-4339-a415-9b8c3a77af2f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.126216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.126216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.126574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.126574] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b79c71-1064-4339-a415-9b8c3a77af2f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.238569] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12bf28a0-51ca-4171-b63e-ba9ad7a0139e: rpc.has_security_group_logging(os_id): False [ 906.270580] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.270700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.270789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.271008] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.271121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.271338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.271405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.271450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.271604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.271684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.271897] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.271990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.272098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.272286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.272361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.272570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.273053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.273139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.273297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.273389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.273485] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 906.357024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.357024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.357024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.357024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.357277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.376568] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 906.628889] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95b79c71-1064-4339-a415-9b8c3a77af2f with status ACTIVE [ 906.629156] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.629292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.629363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.629591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.629682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.629908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.630129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.630226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.630402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.630483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.630674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.630768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.630829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.630972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.631060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.631144] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95b79c71-1064-4339-a415-9b8c3a77af2f is going to be updated. [ 906.632634] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.632821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658460] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.658460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.659175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.659175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b79c71-1064-4339-a415-9b8c3a77af2f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.040026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 907.040026] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e deletion is rescheduled due to dependency. [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.040026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.040026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.040026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.061450] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.061450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.061450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.061450] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.546495] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.568245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.568245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.568245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.568245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.568245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.568801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.568801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.568801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.569499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.571219] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.047929] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.072421] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521f64c2-bdc1-44c3-9e8c-c4a684475213: rpc.has_security_group_logging(os_id): False [ 908.094694] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.094862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.094905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.095253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.095474] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.095638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.095972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.096179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.096279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.096430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.096488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.096564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.096754] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.096847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.096972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.097154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.097235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.097321] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be created. [ 908.182966] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.183430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.183430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.183717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.184187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.199317] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 908.391486] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 908.391732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.555355] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.555355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.555355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.555355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.555355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.555355] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 908.595010] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.595153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.595153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.595403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.595561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.609617] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 910.216796] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 910.216796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.621746] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 910.622038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.622281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.622629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.622910] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.623092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.623212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.623402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623764] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.125363] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 911.125609] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 911.126059] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.126195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.126916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.126916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.126916] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.126916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.126916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.127315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.127315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.127315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.127315] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.127506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.127506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.127639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.127925] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.127925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.127925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.128525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.128525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.128525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.128723] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.632064] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ffb193-a19e-4e24-a26f-e10ccbe9a34e: rpc.has_security_group_logging(os_id): False [ 911.655325] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.655610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.655610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.655795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.655905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.656328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.656328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.656328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.656516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.656580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.656790] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.656885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.656966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.657547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.657604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.657813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.657911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.657978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.658177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.658267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.658357] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 911.722428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.722566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.722638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.722851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.722999] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.736956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 911.960893] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-5cb88c44-dc94-4380-8f58-92068e6633d1 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 911.960893] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 911.960893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.960893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.960893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.960893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.961155] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.961155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.961229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.961361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.961443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.961545] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.333586] env[65973]: INFO networking_nsxv3.common.synchronization [req-555c3d5c-2d2d-47cd-9e84-66891dba6148 req-3ab18c07-de19-4d30-84f6-0a6b8a9dfdc6 tempest-ImagesOneServerNegativeTestJSON-2058089845 tempest-ImagesOneServerNegativeTestJSON-2058089845-project-member] Enqueued Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 912.334857] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e with Priority: HIGHEST for action security_group_members [ 912.334857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.334857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.334857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.335302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.335302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.335302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.335302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.335478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.335553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.335639] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12bf28a0-51ca-4171-b63e-ba9ad7a0139e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.338632] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.338834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.339197] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.339326] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.339629] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.339816] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.339964] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.340315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.340502] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.340717] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.340831] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.340939] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.341061] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.341182] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.341296] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.341652] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.364166] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.364346] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.364481] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.364659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-300" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.364976] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-76262753-a18c-4c7d-b5b2-d31aa00682c7 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.365163] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.365284] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.365709] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.365831] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76262753-a18c-4c7d-b5b2-d31aa00682c7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.464437] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.843936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.844397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.844397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.844397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.844553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.844671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.844764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.844832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.844981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.845070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.845153] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e is going to be updated. [ 912.869652] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.869881] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.870018] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.870446] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.870620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.870814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 76262753-a18c-4c7d-b5b2-d31aa00682c7 not found, creating... [ 912.871101] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.871351] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.871485] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.871711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.871850] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.872155] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.872315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.872517] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.872834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.872982] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.873150] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 76262753-a18c-4c7d-b5b2-d31aa00682c7 is going to be created. [ 912.875062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.875178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.875230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.875387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.875538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.886509] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: IN_PROGRESS for 2s [ 912.904058] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.904364] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.904503] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.904795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.905229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.905296] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.966333] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.468758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.468961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.469039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.469271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.469364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.469464] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 913.512841] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.512841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.513022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.513138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.513292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.525936] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 913.658686] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-2664cc5c-701b-4f10-924d-4dff5f47e3ef service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 913.658877] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-2664cc5c-701b-4f10-924d-4dff5f47e3ef service nova] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 913.659025] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb8132e3-f786-4204-8a08-0f1e0f8ceed6 req-2664cc5c-701b-4f10-924d-4dff5f47e3ef service nova] Enqueued Resource ID: 76262753-a18c-4c7d-b5b2-d31aa00682c7 with Priority: HIGHEST for action port [ 913.659585] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_rules [ 913.659721] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 913.659816] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76262753-a18c-4c7d-b5b2-d31aa00682c7 with Priority: HIGHEST for action port [ 913.660114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.660265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.660468] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.660530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.660706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-76262753-a18c-4c7d-b5b2-d31aa00682c7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.660805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.660888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.661181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.661359] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76262753-a18c-4c7d-b5b2-d31aa00682c7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.762184] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 913.762408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.762651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.762888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.762977] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.163345] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76262753-a18c-4c7d-b5b2-d31aa00682c7 with status ACTIVE [ 914.163727] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.163727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.163851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.164036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.164134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.164343] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.164448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.164530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.164697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.164772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.164956] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.165056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.165118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.165273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.165362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.165462] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76262753-a18c-4c7d-b5b2-d31aa00682c7 is going to be updated. [ 914.190772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.190772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.190772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.191035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.191035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.191216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76262753-a18c-4c7d-b5b2-d31aa00682c7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.265618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.265618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.616989] env[65973]: INFO networking_nsxv3.common.synchronization [req-d08f761b-9bde-4c77-9b1b-dc4c1795ac32 req-e68c342e-94d9-4ee6-906c-a1014a9728cf tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 914.617719] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 914.618081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.618396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.618478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.618700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.618871] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.618976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.619051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.619468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.619662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.619735] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.898785] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e in Status: SUCCESS [ 914.899081] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12bf28a0-51ca-4171-b63e-ba9ad7a0139e deletion is rescheduled due to dependency. [ 914.899238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12bf28a0-51ca-4171-b63e-ba9ad7a0139e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.982681] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-79 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.982901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.983025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.983334] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.983571] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.983724] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.983837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.984745] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.985147] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.985275] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.985386] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.985741] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.985741] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.985741] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.006037] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.006215] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.006351] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.006536] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.006862] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.007041] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.007169] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.007549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.007689] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a84c42-ff2c-4ce2-a63a-9eb70cba7f22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.122657] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.511230] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.511230] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.511830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.511830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.511830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.512050] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 not found, creating... [ 915.512464] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.512581] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.512698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.513101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.513405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.513742] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.513901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.514029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.514287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.514452] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.514553] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 is going to be created. [ 915.538542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 915.538542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.538542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.538542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.538542] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.538910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.538910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.538910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.539058] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.542701] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.543225] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.545398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.545398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.545398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.545398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.625472] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.048183] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.130394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.130394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.130539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.130654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.130756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.130871] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be updated. [ 916.169338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.169558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.169643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.170104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.170427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.186535] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 916.298465] env[65973]: INFO networking_nsxv3.common.synchronization [req-d08f761b-9bde-4c77-9b1b-dc4c1795ac32 req-a22e4910-8582-4ac7-9856-baccb947c2ee service nova] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_rules [ 916.298669] env[65973]: INFO networking_nsxv3.common.synchronization [req-d08f761b-9bde-4c77-9b1b-dc4c1795ac32 req-a22e4910-8582-4ac7-9856-baccb947c2ee service nova] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 916.298822] env[65973]: INFO networking_nsxv3.common.synchronization [req-d08f761b-9bde-4c77-9b1b-dc4c1795ac32 req-a22e4910-8582-4ac7-9856-baccb947c2ee service nova] Enqueued Resource ID: 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 with Priority: HIGHEST for action port [ 916.299416] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_rules [ 916.299630] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 916.299767] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 with Priority: HIGHEST for action port [ 916.300091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.300279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.300344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.300604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.300644] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.301777] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.304031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.304031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.304031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.304031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.304031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.304031] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a84c42-ff2c-4ce2-a63a-9eb70cba7f22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.552130] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.807847] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.807986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.808257] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 with status ACTIVE [ 916.808464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.808598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.808679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.808930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.809010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.809215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.809318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.809404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.809580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.809675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.809876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.810000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.810072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.810308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.810389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.810498] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91a84c42-ff2c-4ce2-a63a-9eb70cba7f22 is going to be updated. [ 916.842037] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.842037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.842037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.842037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.842421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.842421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a84c42-ff2c-4ce2-a63a-9eb70cba7f22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.056801] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.056971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.057052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.057285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.057381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.057480] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 917.094094] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.094094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.094261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.094386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.094543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.110723] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 917.935111] env[65973]: INFO networking_nsxv3.common.synchronization [req-1fe25dae-c19d-4498-9d04-f671467a1e98 req-63db6074-e152-4f27-bad2-cdeca29b8d62 tempest-ImagesOneServerTestJSON-468614391 tempest-ImagesOneServerTestJSON-468614391-project-member] Enqueued Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 917.936404] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGHEST for action security_group_members [ 917.936775] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.936919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.936919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.937390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.937390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.937390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.937643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.937643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.937745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.937745] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.198169] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 918.198404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.198962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.199222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.199462] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.199589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.199655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.199865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.199900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.199985] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.440448] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.440708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.440786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.441106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.441315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.441530] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.441636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.441700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.441870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.441952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.442053] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 is going to be updated. [ 918.508161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.508400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.508400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.508684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.508933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.526121] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: IN_PROGRESS for 2s [ 918.703573] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.122341] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 919.122761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.122761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.122954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.123168] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.123326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.123398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.123558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.123642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.123716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.123813] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.206113] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.627229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.627229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.627229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.627229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.627229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.627229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.627229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.627598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.627598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.627695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.627847] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.632234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.632234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.632234] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.708612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.708776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.708851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.709157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.709206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.709308] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be updated. [ 919.765184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.765340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.765411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.765634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.765783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.775713] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 920.135241] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ffb193-a19e-4e24-a26f-e10ccbe9a34e: rpc.has_security_group_logging(os_id): False [ 920.153640] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.153817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.153858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.154930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.154930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.154930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.154930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.154930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.155501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.155501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.155728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.155728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.155868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.155913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.156061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.157097] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.157097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.157364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.158031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.158031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.158031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 920.223733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.225047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.225047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.225047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.225047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.239726] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 920.535883] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 in Status: SUCCESS [ 920.535988] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 deletion is rescheduled due to dependency. [ 920.536068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.789270] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 921.789270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.789737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.789737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.789737] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.789937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.789937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.790071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.790915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.790915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.790915] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.806559] env[65973]: INFO networking_nsxv3.common.synchronization [None req-98922cd5-744c-4991-bf3b-6faf089c585d None None] Enqueued Resource ID: 8f3ac017-4d5b-46db-bf95-1b35b52b20ba with Priority: HIGHEST for action port [ 921.807329] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f3ac017-4d5b-46db-bf95-1b35b52b20ba with Priority: HIGHEST for action port [ 921.807494] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f3ac017-4d5b-46db-bf95-1b35b52b20ba taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.807586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f3ac017-4d5b-46db-bf95-1b35b52b20ba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.807586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f3ac017-4d5b-46db-bf95-1b35b52b20ba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.811509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f3ac017-4d5b-46db-bf95-1b35b52b20ba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.811509] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f3ac017-4d5b-46db-bf95-1b35b52b20ba',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.133037] env[65973]: INFO networking_nsxv3.common.synchronization [req-fcbf8df7-d5c1-4c5c-ba3b-69e5b2cc4641 req-60c3bc9d-5428-4fee-98f6-b94125f10b20 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 922.133694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 922.134133] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.134280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.134427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.134561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.134725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.134818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.134885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.135130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.135541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.135541] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.255573] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 922.255802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.293090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.293090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.293090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.293090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.293504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.293504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.294504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.294504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.294504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.294504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.294765] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.294765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.294765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.294872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.294942] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.295042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.295098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.295843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.295843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.295843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.295843] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.315155] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f3ac017-4d5b-46db-bf95-1b35b52b20ba [ 922.315212] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.315633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.315633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.315752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.315752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.315863] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f3ac017-4d5b-46db-bf95-1b35b52b20ba already deleted. [ 922.315914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f3ac017-4d5b-46db-bf95-1b35b52b20ba" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.538145] env[65973]: INFO networking_nsxv3.common.synchronization [req-d7c72785-fce0-443e-9971-6e1182b9adbc req-1b2e7719-f211-4a8d-aaaa-63d2c61f481c tempest-AttachInterfacesV270Test-739455640 tempest-AttachInterfacesV270Test-739455640-project-member] Enqueued Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 922.538721] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 922.539051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.539177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.539249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.539541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.539703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.539805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.539870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.541318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.541415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.541529] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.600596] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9174ea1b-04ec-4738-ba92-35ae69e8c6ab tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 922.601210] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 922.601529] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.601667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.601731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.602094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.606963] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.638698] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.638917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.639096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.639509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.639564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.640203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.640264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 922.679980] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.680636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.680795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.681188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.681310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.692582] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 922.708130] env[65973]: INFO networking_nsxv3.common.synchronization [None req-cd0456a2-7ddf-4a63-80b5-2642e1f76bc0 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 922.708699] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 922.709014] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.709725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.800437] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521f64c2-bdc1-44c3-9e8c-c4a684475213: rpc.has_security_group_logging(os_id): False [ 922.821693] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.821693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.821693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.821693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.821693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.822169] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.822281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.822529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.822725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.822814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.823025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.823095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.823280] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.823373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.823432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.823567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.823637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.823718] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be updated. [ 922.900386] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.900630] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-463" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.900706] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-463" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.901092] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-463" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.901372] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.901535] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.901657] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.901900] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.902083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.902281] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.902397] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.902539] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.902723] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.902723] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.902883] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.902956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.904770] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.904912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.904974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.905120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.905265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.923170] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 922.924980] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.925193] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.925353] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.925553] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-463" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.925892] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-73a68be9-7897-412b-9491-14356d058474 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.926096] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.926237] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.926573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.926902] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a68be9-7897-412b-9491-14356d058474',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.044704] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.044911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.045233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.045628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.045812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.046275] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.046455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.046559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.046808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.046911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.047048] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 already deleted. [ 923.047180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.128440] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.128645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.128693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.128888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.129021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.129133] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa already deleted. [ 923.129297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.129715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.129803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.129895] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.429650] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.429893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.430036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.430401] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.430552] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.430709] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 73a68be9-7897-412b-9491-14356d058474 not found, creating... [ 923.430966] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.431136] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.431291] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.431496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.431643] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.431905] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.434065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.434065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.434065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.434065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.434065] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 73a68be9-7897-412b-9491-14356d058474 is going to be created. [ 923.460843] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.460843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.462492] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.462664] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.463098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.463261] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.655504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.656025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.656192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.656904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.656904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.656904] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa already deleted. [ 923.656904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.156759] env[65973]: INFO networking_nsxv3.common.synchronization [None req-389948d5-e001-46e7-a5a5-bad0de6fffc2 None None] Enqueued Resource ID: aaeac7e8-e3dd-4107-a69d-97fe94381d71 with Priority: HIGHEST for action port [ 924.159923] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaeac7e8-e3dd-4107-a69d-97fe94381d71 with Priority: HIGHEST for action port [ 924.159923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaeac7e8-e3dd-4107-a69d-97fe94381d71 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.159923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaeac7e8-e3dd-4107-a69d-97fe94381d71" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.159923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaeac7e8-e3dd-4107-a69d-97fe94381d71" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.159923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaeac7e8-e3dd-4107-a69d-97fe94381d71" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.159923] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaeac7e8-e3dd-4107-a69d-97fe94381d71',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.284032] env[65973]: INFO networking_nsxv3.common.synchronization [req-d7c72785-fce0-443e-9971-6e1182b9adbc req-4b9984ca-3736-4d73-87b5-60a35f41ff45 service nova] Enqueued Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_rules [ 924.284032] env[65973]: INFO networking_nsxv3.common.synchronization [req-d7c72785-fce0-443e-9971-6e1182b9adbc req-4b9984ca-3736-4d73-87b5-60a35f41ff45 service nova] Enqueued Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 924.284032] env[65973]: INFO networking_nsxv3.common.synchronization [req-d7c72785-fce0-443e-9971-6e1182b9adbc req-4b9984ca-3736-4d73-87b5-60a35f41ff45 service nova] Enqueued Resource ID: 73a68be9-7897-412b-9491-14356d058474 with Priority: HIGHEST for action port [ 924.288031] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_rules [ 924.288031] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 924.288031] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a68be9-7897-412b-9491-14356d058474 with Priority: HIGHEST for action port [ 924.288031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.288031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.288031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.288031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.288031] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.288974] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.289609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.289900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.290406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.290863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.291285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.293069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.293069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.293069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.293069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.298024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-73a68be9-7897-412b-9491-14356d058474 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.298024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.298024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.298024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.298024] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a68be9-7897-412b-9491-14356d058474',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.661556] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaeac7e8-e3dd-4107-a69d-97fe94381d71 [ 924.661854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.662275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.662374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.662636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.662728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.662880] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaeac7e8-e3dd-4107-a69d-97fe94381d71 already deleted. [ 924.662968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaeac7e8-e3dd-4107-a69d-97fe94381d71" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.707233] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 924.708202] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 924.708202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.798113] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.799599] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.799743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.800040] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73a68be9-7897-412b-9491-14356d058474 with status ACTIVE [ 924.800282] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.800402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.800491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.800706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.800786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.800951] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.801057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.801122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.801429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.801526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.801744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.801861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.801940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.802121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.802308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.802343] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73a68be9-7897-412b-9491-14356d058474 is going to be updated. [ 924.826013] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.826013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.826013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.826013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.826013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.826013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73a68be9-7897-412b-9491-14356d058474" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.946630] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 924.946947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.301046] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.804431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.804607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.804675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.804903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.804997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.805113] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 is going to be created. [ 925.832441] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.832634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.832676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.832898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.833097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.847287] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: UNINITIALIZED for 2s [ 927.351050] env[65973]: INFO networking_nsxv3.common.synchronization [req-a825039c-44ff-4301-9579-04612577bbfe req-6446e7b9-823d-412f-8015-dc07fd40cdb1 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 927.352128] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 927.352309] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.352498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.352498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.353428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.353428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.353428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.353428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.353428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.353428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.353428] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.493578] env[65973]: INFO networking_nsxv3.common.synchronization [req-cc76fa4e-5551-438d-b9f9-30e7a98dd892 req-f1493f07-3b05-497f-ade9-a69fed42d311 tempest-ServersAdminTestJSON-1145636844 tempest-ServersAdminTestJSON-1145636844-project-member] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 927.494639] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGHEST for action security_group_members [ 927.494974] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.495160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.495256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.495556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.495707] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.496066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.496218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.496445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.496606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.496744] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.544208] env[65973]: INFO networking_nsxv3.common.synchronization [req-94418d9a-1f81-4372-bd5f-a6d3c5f880c7 req-1ebf0924-e622-4eb5-9109-d12a7793b2c0 tempest-MultipleCreateTestJSON-1407141040 tempest-MultipleCreateTestJSON-1407141040-project-member] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 927.544208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGHEST for action security_group_members [ 927.544456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.544456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.855488] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.858939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: SUCCESS [ 927.859184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.859343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.859552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.859786] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.859853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.859916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.860062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.860150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.860282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.860385] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.999427] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.999634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.999634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.999883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.025797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.025797] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.026064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.026107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.028037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.028037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.028037] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be updated. [ 928.071498] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.071645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.072539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.072539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.072539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.087762] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: IN_PROGRESS for 2s [ 928.358357] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.362846] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.362994] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.363113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.363312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.363495] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.364394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.364678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.364832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.364922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.365028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.365182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.365282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.365348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.365484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.365632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.366198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.366270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.366607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.366607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.367972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.368109] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.541506] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8ec72de4-a2f4-442e-b3c0-163ec0c188ba tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 928.542045] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 928.542353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.542519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.542626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.542886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.542966] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.639168] env[65973]: INFO networking_nsxv3.common.synchronization [None req-31750abf-38a6-42f7-bdf4-820094f83a7c tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 928.639168] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 928.639381] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.639646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.861887] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.862161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.862161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.862376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.862477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.862579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 928.870530] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a7bdbe9-2d27-4831-96b5-7ff1750a3241: rpc.has_security_group_logging(os_id): False [ 928.894856] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.895084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.895084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.895315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.895411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.895669] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.895859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.895859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.896065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.896112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.896339] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.896503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.896583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.896754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.896842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.897119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.897271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.897338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.897507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.897588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.897698] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 is going to be created. [ 928.908650] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.908888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.908888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.909126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.909285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.928504] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 928.978651] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.978908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.979034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.979359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.979657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.993252] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: IN_PROGRESS for 2s [ 929.067192] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.067192] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59c44f2-4848-4042-b55e-827765296b4c already deleted. [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.067192] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.067659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.067659] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.587209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.587614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.587614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.587696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.587766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.587861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59c44f2-4848-4042-b55e-827765296b4c already deleted. [ 929.587943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.098549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 in Status: SUCCESS [ 930.098549] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 deletion is rescheduled due to dependency. [ 930.098675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.376565] env[65973]: INFO networking_nsxv3.common.synchronization [req-e9b43d36-0439-4dba-bd45-61738bff4a36 req-8e664732-17d9-42d0-92f5-460fedc09f1a tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 930.377153] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 930.377552] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.377675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.377745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.377944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.378151] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.378263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.378397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.378512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.378627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.378804] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.720865] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.721323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.721323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.721475] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.721739] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.721894] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.722021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.722231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.722375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.722676] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.722798] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.722904] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.723015] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.723127] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.723230] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.723382] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.748989] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.750014] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.750014] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.750014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-112" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.750014] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-271e1bd6-2478-464f-8d1c-a7f33e10719d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.750379] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.750379] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.750689] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.750761] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('271e1bd6-2478-464f-8d1c-a7f33e10719d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.881335] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.943949] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.943949] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.943949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.943949] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.007829] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: SUCCESS [ 931.008100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.254088] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.254467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.254675] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.255066] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.255295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.255505] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 271e1bd6-2478-464f-8d1c-a7f33e10719d not found, creating... [ 931.255876] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.256142] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.256353] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.256658] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.256812] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.257252] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.257399] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.257553] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.257862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.258050] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.258255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 271e1bd6-2478-464f-8d1c-a7f33e10719d is going to be created. [ 931.280259] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.280570] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.280664] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.280905] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.281114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.281339] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.383670] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.446526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.446701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.446701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.446891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.446988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447195] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.447293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.447369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.447500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.447575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447662] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be updated. [ 931.474898] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.475065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.475137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.475363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.475521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.485253] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: IN_PROGRESS for 2s [ 931.886369] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.886671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.886671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.886828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.886920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.887031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 931.917597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.917798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.917900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.918305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.918526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.929838] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 931.993809] env[65973]: INFO networking_nsxv3.common.synchronization [req-e9b43d36-0439-4dba-bd45-61738bff4a36 req-cadbeb88-ff61-498e-84d0-0e4a152d4698 service nova] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_rules [ 931.993809] env[65973]: INFO networking_nsxv3.common.synchronization [req-e9b43d36-0439-4dba-bd45-61738bff4a36 req-cadbeb88-ff61-498e-84d0-0e4a152d4698 service nova] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 931.993921] env[65973]: INFO networking_nsxv3.common.synchronization [req-e9b43d36-0439-4dba-bd45-61738bff4a36 req-cadbeb88-ff61-498e-84d0-0e4a152d4698 service nova] Enqueued Resource ID: 271e1bd6-2478-464f-8d1c-a7f33e10719d with Priority: HIGHEST for action port [ 931.994434] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_rules [ 931.994574] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 931.994679] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 271e1bd6-2478-464f-8d1c-a7f33e10719d with Priority: HIGHEST for action port [ 931.995291] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.995291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.995291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.995569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.995569] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.996205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.996334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.998612] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-271e1bd6-2478-464f-8d1c-a7f33e10719d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.998612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.998612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.998612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.998878] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('271e1bd6-2478-464f-8d1c-a7f33e10719d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.502875] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 271e1bd6-2478-464f-8d1c-a7f33e10719d with status ACTIVE [ 932.502875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.502875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.502875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.502875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.503614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.503614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.503614] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 271e1bd6-2478-464f-8d1c-a7f33e10719d is going to be updated. [ 932.504721] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.504931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.525333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.525509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.525555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.525829] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.526013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.526220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-271e1bd6-2478-464f-8d1c-a7f33e10719d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.496991] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e in Status: SUCCESS [ 933.497579] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e deletion is rescheduled due to dependency. [ 933.497579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.943041] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.943041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.943041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.943041] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.445047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.947205] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.450193] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.450384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.450448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.450662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.450755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.450854] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 935.478484] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.478676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.478676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.478887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.479038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.487890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 936.233913] env[65973]: INFO networking_nsxv3.common.synchronization [req-e6b1a0e9-d046-4743-bc35-21cbdf35b0d3 req-a6ef2ff9-f073-48b0-bb64-1a98c5f63f5b tempest-AttachInterfacesV270Test-739455640 tempest-AttachInterfacesV270Test-739455640-project-member] Enqueued Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 936.234407] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGHEST for action security_group_members [ 936.234407] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.234875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.234875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.234875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.235043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.235150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.235273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.235383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.235472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.235577] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.563666] env[65973]: INFO networking_nsxv3.common.synchronization [req-5d47dff8-bd4f-4926-85b8-a8e3518922e0 req-c5e90a53-a59a-4c7f-be7c-c2b2b3275c06 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 936.563666] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 936.563867] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.563981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.564062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.564294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.564455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.564558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.564620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.564769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.564854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.564947] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.737958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.738223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.738315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.738676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.738676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.738884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.739014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.739113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.739334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.739435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.739527] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 is going to be updated. [ 936.772202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.772380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.772380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.773350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.773350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.782192] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: IN_PROGRESS for 2s [ 937.067121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.068566] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.068566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.068890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.068890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 937.099265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.099265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.099265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.099265] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.099655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.109668] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 937.498228] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 937.498602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.498785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499224] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.499744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.499833] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.002419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.002691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.002691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.002880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.003066] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.003171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.003236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.003431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.003522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.003554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.003792] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.003792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.003891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.003991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.004148] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.004249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.004333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.004433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.004508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.004593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.004681] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.510557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c: rpc.has_security_group_logging(os_id): False [ 938.531736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.531736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.531736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.531736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.553266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.553266] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.553266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.553266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.553502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.553534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.553993] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.554214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.554214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.554421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.554507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.554804] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.555024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.555168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.555407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.555547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.555688] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 938.602647] env[65973]: INFO networking_nsxv3.common.synchronization [req-e88a50d0-2e69-4c1b-97ef-4349bc8903bd req-b55e1ebf-9ed8-44f8-b055-c74576d0b947 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 938.603316] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 938.603449] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.603522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.603591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.603794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.603941] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.605628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.606284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.606284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.606284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.606284] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.624223] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.624338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.624338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.624550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.624694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.641725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 938.795088] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 in Status: SUCCESS [ 938.795239] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 deletion is rescheduled due to dependency. [ 938.795430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.988200] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.988381] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.988551] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.988853] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.989148] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.989352] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.989509] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.989730] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.989872] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.990093] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.990201] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.990321] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.990433] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.990539] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.990640] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.990766] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.010813] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.010998] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.011112] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.011323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.011661] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-c73dc3df-5bc2-444f-a1c7-623d880321a8 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.011839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.011960] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.012356] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.012500] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c73dc3df-5bc2-444f-a1c7-623d880321a8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.112823] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.121199] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 939.121417] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 939.121534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.517114] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.517114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.517114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.517549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.517549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.517549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port c73dc3df-5bc2-444f-a1c7-623d880321a8 not found, creating... [ 939.517942] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.517942] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518111] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.518196] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.518355] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.518642] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.518795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518909] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.519131] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.519264] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.519400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: c73dc3df-5bc2-444f-a1c7-623d880321a8 is going to be created. [ 939.539819] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.540569] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.540822] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.541303] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.541613] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.541842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.614667] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.118060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.118060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.118200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.119078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.119078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.119078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 940.149431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.149629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.149629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.149832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.149986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.162390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 940.654653] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 940.655027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.776936] env[65973]: INFO networking_nsxv3.common.synchronization [req-e88a50d0-2e69-4c1b-97ef-4349bc8903bd req-8b1be9f3-ddf0-42cf-be78-b8b87adb8964 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 940.777130] env[65973]: INFO networking_nsxv3.common.synchronization [req-e88a50d0-2e69-4c1b-97ef-4349bc8903bd req-8b1be9f3-ddf0-42cf-be78-b8b87adb8964 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 940.777265] env[65973]: INFO networking_nsxv3.common.synchronization [req-e88a50d0-2e69-4c1b-97ef-4349bc8903bd req-8b1be9f3-ddf0-42cf-be78-b8b87adb8964 service nova] Enqueued Resource ID: c73dc3df-5bc2-444f-a1c7-623d880321a8 with Priority: HIGHEST for action port [ 940.777491] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 940.777632] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 940.777711] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c73dc3df-5bc2-444f-a1c7-623d880321a8 with Priority: HIGHEST for action port [ 940.778257] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.778399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.778471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.778667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.778747] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.779632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.779632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.779812] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c73dc3df-5bc2-444f-a1c7-623d880321a8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.779902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.779964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.780141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.780210] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c73dc3df-5bc2-444f-a1c7-623d880321a8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.283752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.283915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.284227] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c73dc3df-5bc2-444f-a1c7-623d880321a8 with status ACTIVE [ 941.284432] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.284562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.284657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.285106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.285248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.285358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.285519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.285566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.285697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.285838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.285978] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.286174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.286174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.286295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.286364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.286489] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c73dc3df-5bc2-444f-a1c7-623d880321a8 is going to be updated. [ 941.308260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.308422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.308479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.308691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.308833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.308996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c73dc3df-5bc2-444f-a1c7-623d880321a8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.172376] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 942.172678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.172808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.173038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.173227] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.173348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.173415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.173579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.173661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.173754] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.676662] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.155408] env[65973]: INFO networking_nsxv3.common.synchronization [req-098cdfab-20df-47a3-80c9-c2fa5d288ec8 req-5f5e8b7a-2b9c-4b4d-a235-6b1b47ab7105 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 943.155990] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 943.156328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.156456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.156532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.157392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.157392] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.157392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.157392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.157392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.157705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.157705] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.179480] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.459622] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.459880] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.460047] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.460365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.460619] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.460780] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.460908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.461179] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.461331] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.461558] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.461674] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.461784] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.461891] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.461996] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.462114] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.462268] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.482218] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.482413] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.482514] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.482719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.483055] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-e90814f6-f2a9-408e-916e-e56ccdec021d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.483229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.483348] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.483682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.483819] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90814f6-f2a9-408e-916e-e56ccdec021d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.659817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.659983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.660071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.660292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.660409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.660613] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.660715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.660772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.660937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.661033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.661122] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 943.683918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.683918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.683918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.683918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.683918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.683918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 943.693253] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.693253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.693253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.693253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.693446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.701863] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 943.720661] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.720799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.720865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.721101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.721242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.740714] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 943.986184] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.986347] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.986513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.986834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.987417] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.987417] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port e90814f6-f2a9-408e-916e-e56ccdec021d not found, creating... [ 943.987865] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.988024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.988151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.988383] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.988522] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.988804] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.988985] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.989176] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.989384] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.989517] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.989650] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: e90814f6-f2a9-408e-916e-e56ccdec021d is going to be created. [ 944.012038] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.012038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.012038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.012038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.012038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.012038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.723078] env[65973]: INFO networking_nsxv3.common.synchronization [req-098cdfab-20df-47a3-80c9-c2fa5d288ec8 req-d2457cc7-c698-4149-8179-189433e6f682 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 944.723493] env[65973]: INFO networking_nsxv3.common.synchronization [req-098cdfab-20df-47a3-80c9-c2fa5d288ec8 req-d2457cc7-c698-4149-8179-189433e6f682 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 944.723563] env[65973]: INFO networking_nsxv3.common.synchronization [req-098cdfab-20df-47a3-80c9-c2fa5d288ec8 req-d2457cc7-c698-4149-8179-189433e6f682 service nova] Enqueued Resource ID: e90814f6-f2a9-408e-916e-e56ccdec021d with Priority: HIGHEST for action port [ 944.724637] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 944.724916] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 944.725036] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90814f6-f2a9-408e-916e-e56ccdec021d with Priority: HIGHEST for action port [ 944.725465] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.725673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.725956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.727281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.729114] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.729114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.729114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.729114] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90814f6-f2a9-408e-916e-e56ccdec021d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.729114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.729114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.729447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.729447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90814f6-f2a9-408e-916e-e56ccdec021d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.230902] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.231054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.231410] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e90814f6-f2a9-408e-916e-e56ccdec021d with status ACTIVE [ 945.231410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.231503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.232078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.232078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.232078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.232078] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.232252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.232252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.232318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.232399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.232563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.232677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.232764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.234379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.234379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.234379] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e90814f6-f2a9-408e-916e-e56ccdec021d is going to be updated. [ 945.254457] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.254580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.254651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.254893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.255055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.255236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90814f6-f2a9-408e-916e-e56ccdec021d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.713052] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 945.713310] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 945.713462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.713696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.713981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.715032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.715032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.715032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.715032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.715032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.715032] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.768594] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 945.768975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.769161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.769475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.769719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.769867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.769972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.770194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.770314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.770483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.770574] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.217219] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.273891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.273891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.273891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.274433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.274433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.274603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.274603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.274913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.274913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.274913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.275127] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.275292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.275292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.275392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.275532] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.275614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.275649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.275807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.275886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.275920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.276144] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.719368] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.779166] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 946.798903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.799164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.799323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.799545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.799641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.799839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.799990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.800122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.800322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.800476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.800705] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.800816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.800876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.801039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.801117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.801371] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.801489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.801546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.801725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.801827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.801931] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 946.868511] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.868744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.868809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.869035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.869198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.882749] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 947.222500] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.222745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.222872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.223181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.223292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.223395] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 947.255943] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.256084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.256125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.256492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.257183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.268191] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 948.895556] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 948.895952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.278455] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 949.278721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.278880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.279130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.279333] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.279464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.279560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.279749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.279831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.280065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.280065] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.438639] env[65973]: INFO networking_nsxv3.common.synchronization [req-a620df6c-d431-4918-84bb-e322f2b21264 req-5de4ea22-b840-410c-8b64-3045e1e4e65e tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 949.439194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGHEST for action security_group_members [ 949.439504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.439807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.439807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.439912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.440047] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.440152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.440250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.440390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.440467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.440553] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.782062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.782216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.782286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.782516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.782684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.782789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.782855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.783030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.783122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.783213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.783383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.783644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.783727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.783879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.784031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.784127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.784189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.784329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.784405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.784491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.784579] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.944744] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.944744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.944744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.944744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.968907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.969205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.969332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.969398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.969622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.969706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.969795] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db is going to be updated. [ 950.005169] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.005394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.005471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.005695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.006321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.025653] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: IN_PROGRESS for 2s [ 950.290264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 950.315580] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.315580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.315580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.315580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.315580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.315580] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.316234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.316234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.316439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.316439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.317177] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.317338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.317442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.318640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.318640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.318640] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 950.383072] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.383072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.383072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.383072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.383072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.396832] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 951.005067] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-38bb7ebf-1c11-4e43-878e-18ee92b1f66d tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 951.005398] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 951.005709] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.005847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.005924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.007474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.007675] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.008208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.008425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.008623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.008762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.008960] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.455867] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-6c82ab97-f35b-4114-a9d6-832683eb8068 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 951.456743] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 951.458233] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.458339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.512510] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.512720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.512762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.515017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.515017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.515017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 951.551089] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.551089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.551089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.551089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.551089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.563245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 951.888143] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.888328] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-152" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.888458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-152" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.888793] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-152" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.889199] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.889360] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.889477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.889701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.889846] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.890062] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.890179] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.890319] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.890452] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.890572] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.890677] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.890810] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.909781] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.909943] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.910091] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.910310] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-152" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.910705] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-7e147538-83cf-4275-969f-b5a970018aa0 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.910877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.910995] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.911554] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.911554] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e147538-83cf-4275-969f-b5a970018aa0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.036388] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db in Status: SUCCESS [ 952.036782] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db deletion is rescheduled due to dependency. [ 952.036782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.410901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 952.412700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.414092] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.414311] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.414436] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.414723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.414873] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.415045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 7e147538-83cf-4275-969f-b5a970018aa0 not found, creating... [ 952.415311] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.415478] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.415684] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.415912] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.415970] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.416270] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.416890] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.416890] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.416890] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.417143] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.417143] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 7e147538-83cf-4275-969f-b5a970018aa0 is going to be created. [ 952.437940] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.438218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.438321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.438596] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.438814] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.439051] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.838298] env[65973]: INFO networking_nsxv3.common.synchronization [None req-a65d8f51-0f04-4c5d-9994-d71f1f380f5c tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 952.839024] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 952.839137] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.839202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.839282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.839551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.839739] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.131518] env[65973]: INFO networking_nsxv3.common.synchronization [None req-bdaba1ea-5e56-4e6d-8ef9-5482557e775b tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 953.132965] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 953.133867] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.133867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-2e2c23ba-5a8c-47f3-84d3-cb7d2c178ff1 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-2e2c23ba-5a8c-47f3-84d3-cb7d2c178ff1 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-2e2c23ba-5a8c-47f3-84d3-cb7d2c178ff1 service nova] Enqueued Resource ID: 7e147538-83cf-4275-969f-b5a970018aa0 with Priority: HIGHEST for action port [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 953.218213] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e147538-83cf-4275-969f-b5a970018aa0 with Priority: HIGHEST for action port [ 953.218929] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.219213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.219384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.222096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.222096] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.222096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.222096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.222096] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e147538-83cf-4275-969f-b5a970018aa0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.222096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.222096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.222096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.222096] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e147538-83cf-4275-969f-b5a970018aa0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.365886] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.366946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.366946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.366946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.366946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.366946] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 already deleted. [ 953.366946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.367502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.367502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.367502] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.370528] env[65973]: INFO networking_nsxv3.common.synchronization [req-9ff29248-9286-4a31-bff4-79d59473201c req-47d29563-c318-4548-97ce-4453e2060b02 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 953.371043] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 953.371393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.371483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.371527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.371702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.372334] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.372334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.372334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.372334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.372334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.372565] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.576781] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 953.576781] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 deletion is rescheduled due to dependency. [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.576781] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.576781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.576781] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.725589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.726240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.726604] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e147538-83cf-4275-969f-b5a970018aa0 with status ACTIVE [ 953.726891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.727078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.727195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.727473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.727722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.727832] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.727974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.728163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.728419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.728596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.728800] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.728935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.729014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.729252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.729385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.729517] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e147538-83cf-4275-969f-b5a970018aa0 is going to be updated. [ 953.755491] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e147538-83cf-4275-969f-b5a970018aa0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.874248] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.911262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.911262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.911262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.911262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.911262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.911262] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 already deleted. [ 953.911262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.035074] env[65973]: INFO networking_nsxv3.common.synchronization [req-8bdc7497-c76c-4de8-9502-2714d3eda1ea req-ea583765-0339-4d0d-8c61-021560e4d819 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 954.035610] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 954.035913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.036338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.036469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.036703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.036899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.037043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.037133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.037554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.037789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.037789] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.079046] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.375835] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.479129] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.479129] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-932" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.479129] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-932" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.479129] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-932" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.479129] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.479129] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.479129] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.479432] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.479492] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.479707] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.479836] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.479947] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.480085] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.480173] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.480274] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.480439] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.482832] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.483015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.483142] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.483361] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.483884] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.484069] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.484191] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.484409] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.485038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.485038] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.485038] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.485038] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.485240] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.485240] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.485309] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.485403] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.508528] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.508693] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.508824] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.509037] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-932" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.509529] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-0f4305c4-19af-473a-a3d4-07b40ce3a64c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.509772] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.509901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.510259] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.510449] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f4305c4-19af-473a-a3d4-07b40ce3a64c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.511892] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.512098] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.512182] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.512338] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-210" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.512621] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-7562c43e-995d-4903-b7f8-941ea67ef2f6 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.512783] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.512898] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.513245] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.513318] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7562c43e-995d-4903-b7f8-941ea67ef2f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.539903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.540091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.540137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.540332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.540474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.540666] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.540763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.540826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.540978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.541070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.541155] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 954.569686] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.569884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.569884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.579670] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 954.579877] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.879273] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.879417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.879499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.879706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.879795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.880086] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 954.914337] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.914502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.914573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.914791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.914983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.924969] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 955.014813] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.015427] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.015427] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.015560] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.015648] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.015868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 0f4305c4-19af-473a-a3d4-07b40ce3a64c not found, creating... [ 955.016217] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016319] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016700] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.017126] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.017279] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.017393] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.017602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.017731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.017868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 0f4305c4-19af-473a-a3d4-07b40ce3a64c is going to be created. [ 955.019141] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.019313] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.019435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.019654] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.019789] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.019927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 7562c43e-995d-4903-b7f8-941ea67ef2f6 not found, creating... [ 955.020177] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.020326] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.020466] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.020683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.020841] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.021124] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.021276] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.021426] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.021638] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.021763] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.021897] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 7562c43e-995d-4903-b7f8-941ea67ef2f6 is going to be created. [ 955.043264] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.043486] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.043662] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.043893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.044136] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.044363] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.046035] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.046194] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.046324] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.046589] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.047067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.047067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.081911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.082080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.082152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.082367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.082473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.082568] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 955.151038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.151038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.151038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.151279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.169953] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-b6cb3e43-3c15-4e3b-9737-ffdb44c8f8c5 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-b6cb3e43-3c15-4e3b-9737-ffdb44c8f8c5 service nova] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [req-5ba11e6d-4db5-48a5-9af5-9498b2b8760c req-b6cb3e43-3c15-4e3b-9737-ffdb44c8f8c5 service nova] Enqueued Resource ID: 0f4305c4-19af-473a-a3d4-07b40ce3a64c with Priority: HIGHEST for action port [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_rules [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 955.722042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f4305c4-19af-473a-a3d4-07b40ce3a64c with Priority: HIGHEST for action port [ 955.722931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.723208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.723570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.723794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.724207] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f4305c4-19af-473a-a3d4-07b40ce3a64c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.724476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.724650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.726183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.726183] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f4305c4-19af-473a-a3d4-07b40ce3a64c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.745580] env[65973]: INFO networking_nsxv3.common.synchronization [req-8bdc7497-c76c-4de8-9502-2714d3eda1ea req-0d5e3cbe-d0bc-4ecc-9eef-54c484c63c65 service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 955.745580] env[65973]: INFO networking_nsxv3.common.synchronization [req-8bdc7497-c76c-4de8-9502-2714d3eda1ea req-0d5e3cbe-d0bc-4ecc-9eef-54c484c63c65 service nova] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 955.745580] env[65973]: INFO networking_nsxv3.common.synchronization [req-8bdc7497-c76c-4de8-9502-2714d3eda1ea req-0d5e3cbe-d0bc-4ecc-9eef-54c484c63c65 service nova] Enqueued Resource ID: 7562c43e-995d-4903-b7f8-941ea67ef2f6 with Priority: HIGHEST for action port [ 955.745580] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_rules [ 955.745580] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 955.746185] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7562c43e-995d-4903-b7f8-941ea67ef2f6 with Priority: HIGHEST for action port [ 955.748273] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.748273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.748273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.748273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.748273] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.749353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.749607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.749938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7562c43e-995d-4903-b7f8-941ea67ef2f6 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.750241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.750496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.751601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.751601] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7562c43e-995d-4903-b7f8-941ea67ef2f6',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.231521] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f4305c4-19af-473a-a3d4-07b40ce3a64c with status ACTIVE [ 956.231521] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.231521] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.231521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.233064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.233064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.233064] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f4305c4-19af-473a-a3d4-07b40ce3a64c is going to be updated. [ 956.250450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.250781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.255792] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7562c43e-995d-4903-b7f8-941ea67ef2f6 with status ACTIVE [ 956.255792] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.255971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.256117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.256314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.256425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.256899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.256899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.256899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.256899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.256899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.257191] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.257191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.257270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.260702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.260702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.260702] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7562c43e-995d-4903-b7f8-941ea67ef2f6 is going to be updated. [ 956.266045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.266249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.266249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.266453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.266603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.266770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f4305c4-19af-473a-a3d4-07b40ce3a64c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.289305] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.289305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.289305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.289305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.289822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.289822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7562c43e-995d-4903-b7f8-941ea67ef2f6" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.592138] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 956.592523] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 956.592523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.592673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.592906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.593134] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.593260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.593336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.593684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.593804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.593993] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.937116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 956.937116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.096368] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.185060] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 957.185198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.185381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.187435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.188637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.188637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.188637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.189505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.189616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.189731] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.414795] env[65973]: INFO networking_nsxv3.common.synchronization [req-52cf7ee7-32bb-4e18-90dc-607664910d56 req-ce074ebc-b33b-4086-ae82-d091efde62ce tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 957.415414] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 957.415741] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.415862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.415922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.417307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.417466] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.417580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.417638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.417816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.417900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.418037] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.599160] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.692406] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.778229] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.778229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.778229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.778229] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.778229] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.778608] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.778802] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.779090] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.779291] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.779633] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.779795] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.779946] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.780103] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.780259] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.780406] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.780601] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.803101] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.803101] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.803101] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.803101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.803101] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-41578b20-eac4-4c0b-bb84-dc6ef9724591 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.803101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.803101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.803101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.803101] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41578b20-eac4-4c0b-bb84-dc6ef9724591',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.920855] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.921030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.921030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.921467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.921467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.921914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.921914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.921914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.922129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.922129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.922193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa already deleted. [ 957.922639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.106671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.106671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.106671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.106671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.106671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.106671] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 958.138831] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.139063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.139144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.139405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.139636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.151141] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 958.194716] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.304848] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.305240] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.305482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.305930] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.306216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.306557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 41578b20-eac4-4c0b-bb84-dc6ef9724591 not found, creating... [ 958.306952] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.307257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.307476] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.307834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.308080] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.308690] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.308985] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.309214] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.309593] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.309851] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.310122] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 41578b20-eac4-4c0b-bb84-dc6ef9724591 is going to be created. [ 958.333663] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.333885] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.334027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.334454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.334811] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.335132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.698678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.698925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.699155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.699606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.699606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.699606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 958.748330] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.748498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.748590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.748782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.748932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.758329] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 959.117373] env[65973]: INFO networking_nsxv3.common.synchronization [req-52cf7ee7-32bb-4e18-90dc-607664910d56 req-aeb4068d-86e6-48a7-8841-9ecca7b5e899 service nova] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 959.117373] env[65973]: INFO networking_nsxv3.common.synchronization [req-52cf7ee7-32bb-4e18-90dc-607664910d56 req-aeb4068d-86e6-48a7-8841-9ecca7b5e899 service nova] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 959.117373] env[65973]: INFO networking_nsxv3.common.synchronization [req-52cf7ee7-32bb-4e18-90dc-607664910d56 req-aeb4068d-86e6-48a7-8841-9ecca7b5e899 service nova] Enqueued Resource ID: 41578b20-eac4-4c0b-bb84-dc6ef9724591 with Priority: HIGHEST for action port [ 959.117373] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_rules [ 959.117849] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 959.117849] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41578b20-eac4-4c0b-bb84-dc6ef9724591 with Priority: HIGHEST for action port [ 959.118187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.118352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.118489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.118840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.118941] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.120845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.121029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.121136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.121424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.121671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.122281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.122281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.122281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.122281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.122471] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.123845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-41578b20-eac4-4c0b-bb84-dc6ef9724591 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.123845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.123845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.124092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.124264] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41578b20-eac4-4c0b-bb84-dc6ef9724591',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.626709] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.626709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.626992] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41578b20-eac4-4c0b-bb84-dc6ef9724591 with status ACTIVE [ 959.627303] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.627303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.627663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.627663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.628742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.628742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.628742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.629041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.629041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.629041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.629120] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41578b20-eac4-4c0b-bb84-dc6ef9724591 is going to be updated. [ 959.631325] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.651590] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.651797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.651797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.651993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.652142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.652300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41578b20-eac4-4c0b-bb84-dc6ef9724591" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.135542] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.161714] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 960.162874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.162874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.164025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.164025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.164509] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.637537] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.637990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.639607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.639607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.639607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.639607] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa is going to be created. [ 960.665711] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.665904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.665904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.666114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.666280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.667455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.667588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.667668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.667808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.667960] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.669336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.669452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.669616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.672254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.672254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.672368] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.672422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.672453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.672808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.672808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.672963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.672963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.673076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.673195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.673195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.673296] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.687616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: UNINITIALIZED for 2s [ 960.771321] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 960.771614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.771915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.772184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.772458] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.772560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.773630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.773630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.773630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.773630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.773630] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.774775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.774878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.775184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.775302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.775364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.775530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.775647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.775741] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.176636] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab67debe-f546-499b-8301-c37179fecdee: rpc.has_security_group_logging(os_id): False [ 961.196861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.197485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.197598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.197852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.197944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.198204] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.198320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.198380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.198582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.198988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.199398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.199824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.199934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.200144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.200747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.203101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.203285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.203340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.203500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.203586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.203691] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 961.280043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.280043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.280043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.280277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.280527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.281697] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.284647] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.284751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.300718] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 961.786084] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.288904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.288904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.289237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.289237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.289845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.289845] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 962.322841] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.323077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.323158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.323369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.323533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.335404] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 962.700285] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: UNINITIALIZED for 4s [ 963.011884] env[65973]: INFO networking_nsxv3.common.synchronization [req-6981e6b4-1d02-4fcb-b92e-ee87069f5e8b req-f56cab04-cf92-43f9-9385-941e74c9b2bc tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 963.012452] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 963.012756] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.012900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.012967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.014797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.014973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.015278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.015278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.015385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.015419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.015511] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.318289] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 963.318602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.519022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.519022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.519022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.519500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.519500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.519500] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59c44f2-4848-4042-b55e-827765296b4c already deleted. [ 963.519500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.904312] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.904520] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.904647] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.904919] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.905206] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.905394] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.905513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.905738] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.905882] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.906104] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.906216] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.906320] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.906488] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.906676] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.906733] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.906917] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.930137] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.930414] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.930939] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.931176] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.931678] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b0e864d1-8095-48e0-8e49-81b86d584fc3 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.931851] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.931968] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.932422] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.932585] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e864d1-8095-48e0-8e49-81b86d584fc3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.346093] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 964.346914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.346914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.346914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.346914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.347139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.347139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.347205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.347296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.347394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.347534] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.347627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.347684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.347826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.347986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.348110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.348172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.348905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.348905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.348905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.348905] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.434786] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.435015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.435153] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.435443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.435802] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.435802] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b0e864d1-8095-48e0-8e49-81b86d584fc3 not found, creating... [ 964.436098] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.437188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.437442] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.437729] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.437884] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.438249] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.438413] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.438529] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.438751] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.438887] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.439230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b0e864d1-8095-48e0-8e49-81b86d584fc3 is going to be created. [ 964.459104] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.459348] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.459471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.459749] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.459974] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.460275] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.710227] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: SUCCESS [ 964.711035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.711035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.711306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.711541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.711671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.711736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.711903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.711987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.712095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.712182] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.851319] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a575d40f-4efb-403b-a9bf-a1d03f827661: rpc.has_security_group_logging(os_id): False [ 964.870587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.870763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.870816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.871047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.871159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.871356] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.871474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.871554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.871668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.871746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.871929] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.872039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.872098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.872243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.872307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.872488] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.872583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.872655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.872851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.872932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.873030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 964.942721] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.942721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.942721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.942721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.942721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.957194] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [req-6981e6b4-1d02-4fcb-b92e-ee87069f5e8b req-bcee1d8b-fcfe-441f-99d0-75fd3e984556 service nova] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [req-6981e6b4-1d02-4fcb-b92e-ee87069f5e8b req-bcee1d8b-fcfe-441f-99d0-75fd3e984556 service nova] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [req-6981e6b4-1d02-4fcb-b92e-ee87069f5e8b req-bcee1d8b-fcfe-441f-99d0-75fd3e984556 service nova] Enqueued Resource ID: b0e864d1-8095-48e0-8e49-81b86d584fc3 with Priority: HIGHEST for action port [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_rules [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 965.197748] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e864d1-8095-48e0-8e49-81b86d584fc3 with Priority: HIGHEST for action port [ 965.197748] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.197748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.197748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.198907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.199182] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.200329] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.200554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.200653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.200883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.201536] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.201692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.201785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.202008] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.202165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.202300] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.203345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e864d1-8095-48e0-8e49-81b86d584fc3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.203660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.203660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.204286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.204286] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e864d1-8095-48e0-8e49-81b86d584fc3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.215135] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.707200] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.707200] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.707200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.707200] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e864d1-8095-48e0-8e49-81b86d584fc3 with status ACTIVE [ 965.707200] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.707667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.707667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.707667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.707773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.707896] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.707974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.708044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.708227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.708410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.708473] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.708760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.708760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.708760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.708875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.708909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e864d1-8095-48e0-8e49-81b86d584fc3 is going to be updated. [ 965.718132] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31ede63f-6bd9-48fa-8301-810c9ef645fa: rpc.has_security_group_logging(os_id): False [ 965.732789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.732974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.733047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.733585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.733585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.733766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e864d1-8095-48e0-8e49-81b86d584fc3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.739167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.739605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.739740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.740217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.740217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.740721] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.740884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.741293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.741293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.741514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.741617] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa is going to be created. [ 965.835020] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.835020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.835020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.835020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.835020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.853886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: IN_PROGRESS for 2s [ 966.027371] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5646e47a-5daf-41a8-8154-a6d048c968fa None None] Enqueued Resource ID: 04e21cf3-2710-478b-a9b5-d9de6c242556 with Priority: HIGHEST for action port [ 966.028521] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e21cf3-2710-478b-a9b5-d9de6c242556 with Priority: HIGHEST for action port [ 966.028882] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e21cf3-2710-478b-a9b5-d9de6c242556 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.028882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e21cf3-2710-478b-a9b5-d9de6c242556" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.029093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e21cf3-2710-478b-a9b5-d9de6c242556" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.029227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e21cf3-2710-478b-a9b5-d9de6c242556" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.029312] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e21cf3-2710-478b-a9b5-d9de6c242556',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.216985] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.467928] env[65973]: INFO networking_nsxv3.common.synchronization [req-40ff3347-abaa-4894-a588-cefa56b7a8d7 req-3fe5fd8a-f8a9-4290-a75c-c22ce2c70b93 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 966.468773] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 966.469551] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.469750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.469750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.469998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.470876] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.471122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.471222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.471449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.472044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.472044] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.532638] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04e21cf3-2710-478b-a9b5-d9de6c242556 [ 966.532975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.533179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.533298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.534027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.534027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.534027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04e21cf3-2710-478b-a9b5-d9de6c242556 already deleted. [ 966.534027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e21cf3-2710-478b-a9b5-d9de6c242556" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.836173] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.836540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.836540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.836690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.836751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.836868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59c44f2-4848-4042-b55e-827765296b4c is going to be created. [ 966.865559] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.866313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.866489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.866971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.867158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.880829] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: UNINITIALIZED for 2s [ 966.974117] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 966.974935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.974935] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.974935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.974935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.975200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.975200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.975374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.975476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.975539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.975691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.975792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.977142] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 966.977142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.977142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.977142] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.006144] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.006579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.006579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.006579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.006744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.010999] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.011999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.011999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.011999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.011999] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.012310] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.012541] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.013056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.013323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.013473] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.013580] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.013977] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.014157] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.014298] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.014433] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.014592] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.017965] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 967.037209] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.037328] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.037481] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.037676] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.037950] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.038137] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.038250] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.038746] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.038854] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.479145] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.479356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.479356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.479570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.479739] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.479834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.479917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.480088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.480177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.480266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.480355] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.541672] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.541915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.542057] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.542376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.542529] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.542852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 not found, creating... [ 967.542954] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.543130] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.543242] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.543469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.543606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.543916] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.544087] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.544203] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.544411] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.544539] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.544716] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 is going to be created. [ 967.566825] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.567036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.567151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.567428] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.567663] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.567883] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.868418] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: SUCCESS [ 967.868418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.982513] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.982845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.983029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.983324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.983581] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.983777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.983914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.984159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.984341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.984529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.984831] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.985961] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.985961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.986552] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.280097] env[65973]: INFO networking_nsxv3.common.synchronization [req-40ff3347-abaa-4894-a588-cefa56b7a8d7 req-5f9afcb1-c82b-45e7-b468-8cc914feea5a service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 968.280515] env[65973]: INFO networking_nsxv3.common.synchronization [req-40ff3347-abaa-4894-a588-cefa56b7a8d7 req-5f9afcb1-c82b-45e7-b468-8cc914feea5a service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 968.280515] env[65973]: INFO networking_nsxv3.common.synchronization [req-40ff3347-abaa-4894-a588-cefa56b7a8d7 req-5f9afcb1-c82b-45e7-b468-8cc914feea5a service nova] Enqueued Resource ID: c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 with Priority: HIGHEST for action port [ 968.280983] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 968.281946] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 968.281946] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 with Priority: HIGHEST for action port [ 968.282241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.282420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.282420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.282653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.282732] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.283597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.284288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.284288] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.284288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.284288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.284288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.284288] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.492453] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a575d40f-4efb-403b-a9bf-a1d03f827661: rpc.has_security_group_logging(os_id): False [ 968.511018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.511018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.511018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.511018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.511018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.511018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.511018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.511645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.511645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.511645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.511645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.511645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.511645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.512425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.512425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.512425] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.512425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.513224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.513673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.513851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.513907] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 968.579553] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.579742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.582460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.582955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.583198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.599643] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 968.786710] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.786710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.786861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 with status ACTIVE [ 968.787087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.787258] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.787360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.787614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.787950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.788072] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.788145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.788225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.788443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.788536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.789190] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.789190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.789190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.790254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.790400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.790719] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4 is going to be updated. [ 968.817128] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.817128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.817128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.817366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.817366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.817478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8d29dae-21ae-4d1d-8ec5-27dcbebfe6d4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.898135] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: SUCCESS [ 968.898550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.898711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.899029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.899514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.899680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.899780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.899990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.900120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.900217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.900311] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.913299] env[65973]: INFO networking_nsxv3.common.synchronization [None req-59ffb8cf-e5ac-44d8-bd7f-e5367032ff85 None None] Enqueued Resource ID: 2a23d6d3-647b-4d4e-a4c5-aa2e25977da3 with Priority: HIGHEST for action port [ 968.913724] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a23d6d3-647b-4d4e-a4c5-aa2e25977da3 with Priority: HIGHEST for action port [ 968.914604] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a23d6d3-647b-4d4e-a4c5-aa2e25977da3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.914826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a23d6d3-647b-4d4e-a4c5-aa2e25977da3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.914967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a23d6d3-647b-4d4e-a4c5-aa2e25977da3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.915588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a23d6d3-647b-4d4e-a4c5-aa2e25977da3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.916126] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a23d6d3-647b-4d4e-a4c5-aa2e25977da3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.029206] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 969.030096] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 969.030096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.030742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.030985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.031199] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.031318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.031382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.031570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.031661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.031753] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.403189] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.418587] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a23d6d3-647b-4d4e-a4c5-aa2e25977da3 [ 969.418807] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.419492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.419492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.419492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.419492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.419492] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a23d6d3-647b-4d4e-a4c5-aa2e25977da3 already deleted. [ 969.419492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a23d6d3-647b-4d4e-a4c5-aa2e25977da3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.538441] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.905357] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c59c44f2-4848-4042-b55e-827765296b4c: rpc.has_security_group_logging(os_id): False [ 969.924176] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.924541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.924541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.925306] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.925306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.925732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59c44f2-4848-4042-b55e-827765296b4c is going to be created. [ 969.986105] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.986281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.986420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.986653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.986961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.000118] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: IN_PROGRESS for 2s [ 970.041976] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.531522] env[65973]: INFO networking_nsxv3.common.synchronization [None req-83d72a9c-8902-4b20-86e4-2c17aa9a4221 tempest-ServersTestBootFromVolume-26785003 tempest-ServersTestBootFromVolume-26785003-project-member] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 970.532229] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 970.532874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.532874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.533952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.534267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.534357] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.545547] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.545688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.545780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.546033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.546129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.546488] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 970.578358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.578358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.578358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.578658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.578799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.590219] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 970.618640] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 970.618975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.687850] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b6a5363a-39c2-4018-8ce1-d25c3d2d0503 tempest-ServersTestBootFromVolume-26785003 tempest-ServersTestBootFromVolume-26785003-project-member] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 970.688358] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 970.688607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.688739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.060362] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.062852] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 already deleted. [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.062852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.062852] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.066509] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b2137438-4321-4341-ad9a-f6da0f999b36 None None] Enqueued Resource ID: 75884019-9791-4d73-ba9e-c4279d2052f5 with Priority: HIGHEST for action port [ 971.066812] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75884019-9791-4d73-ba9e-c4279d2052f5 with Priority: HIGHEST for action port [ 971.067453] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-75884019-9791-4d73-ba9e-c4279d2052f5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.068289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75884019-9791-4d73-ba9e-c4279d2052f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.068289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75884019-9791-4d73-ba9e-c4279d2052f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.068289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75884019-9791-4d73-ba9e-c4279d2052f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.068721] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75884019-9791-4d73-ba9e-c4279d2052f5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.575116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75884019-9791-4d73-ba9e-c4279d2052f5 [ 971.575116] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.575116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.575116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.575116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.575116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.575116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75884019-9791-4d73-ba9e-c4279d2052f5 already deleted. [ 971.575116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75884019-9791-4d73-ba9e-c4279d2052f5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.589024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.589024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.589024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.589024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.589024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.589024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 already deleted. [ 971.589024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.862054] env[65973]: INFO networking_nsxv3.common.synchronization [req-1ec90dd7-6b5d-4752-a1a2-99d929085e39 req-c2068c51-dbc8-4da9-b597-a8322e5db1ca tempest-ServersWithSpecificFlavorTestJSON-881162510 tempest-ServersWithSpecificFlavorTestJSON-881162510-project-member] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 971.862687] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGHEST for action security_group_members [ 971.863106] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.863238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.863295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.863507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.863659] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.863749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.863810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.863969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.864088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.864184] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.014088] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: SUCCESS [ 972.015884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.367090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.367090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.367090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.367516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.396337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.397080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.397080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.397080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.397592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.398478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.398478] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be updated. [ 972.437726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.437726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.437726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.437726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.437726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.449898] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: IN_PROGRESS for 2s [ 972.604219] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 972.604549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.604648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.605531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.606141] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.606141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.606141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.606141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.606556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.606556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.606556] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.722310] env[65973]: INFO networking_nsxv3.common.synchronization [req-3724c97c-d839-4330-a41b-e3f4e1db7474 req-f108d856-7d13-4b69-a0e9-f7f12e0cd61e tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 972.724149] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 972.724149] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.724149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.724149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.724149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.724149] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.724149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.724831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.724831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.724831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.724831] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.993061] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ecb1a33d-5d37-4ff3-9e0c-ead47b8ffbb4 tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 972.993897] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 972.994329] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.994518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.994609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.994938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.995096] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.027388] env[65973]: INFO networking_nsxv3.common.synchronization [req-3724c97c-d839-4330-a41b-e3f4e1db7474 req-37088965-7383-413e-8356-fec8d38f5c88 tempest-ServersTestMultiNic-1308312640 tempest-ServersTestMultiNic-1308312640-project-member] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 973.027388] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGHEST for action security_group_members [ 973.027388] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.027388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.110433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.110673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.110746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.110965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.112022] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.112022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.112022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.112022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.112022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.112304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.112304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.112387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.112422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.112574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.112708] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.112794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.112850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.112988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.114225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.114225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.114225] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.157051] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ae7daa59-16fa-44b4-ae8e-928dce381cd8 tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 973.157975] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 973.157975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.157975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.227656] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.520962] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.520962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.520962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.520962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.520962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.520962] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 already deleted. [ 973.520962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.521609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.521609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.521609] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.617044] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 973.636258] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.636466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.636466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.636699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.639254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.639254] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.639254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.639254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.639254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.639896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.639896] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.639896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.639896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.640146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.640266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.640442] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.640613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.640675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.640809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.640881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.640980] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 973.716443] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.716625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.717160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.717160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.717160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.728249] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 973.730725] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.046992] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.047157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.047217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.047443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.047530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.047641] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 already deleted. [ 974.047748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.233152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.233319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.233391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.233623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.233757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.233886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 974.280961] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.280961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.281174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.281283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.281450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.295134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 974.463424] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c in Status: SUCCESS [ 974.463602] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c deletion is rescheduled due to dependency. [ 974.463747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.958906] env[65973]: INFO networking_nsxv3.common.synchronization [None req-929ada31-279d-493f-802a-0b914ee3354d None None] Enqueued Resource ID: c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa with Priority: HIGHEST for action port [ 974.960576] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa with Priority: HIGHEST for action port [ 974.962932] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.962932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.963231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.963534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.963669] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.969675] env[65973]: INFO networking_nsxv3.common.synchronization [req-322711a5-f585-4c73-9e0d-2df88d1dec00 req-83ff2951-595a-4164-aa15-67ade2d9f02e tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 974.970743] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 974.970874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.971020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.971096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.971372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.972141] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.972141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.972141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.972334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.972386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.972611] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.475197] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa [ 975.475471] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.475656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.475750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.476252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.476462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.476639] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa already deleted. [ 975.476778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8aa3aab-f3d8-49f4-8f58-9883b05fc7aa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.477188] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.477352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.477423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.477735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.518613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.519103] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.519322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.519441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.519760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.519906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.520109] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 975.563193] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.563538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.563656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.563965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.564571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.575035] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 975.745022] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 975.745022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.306776] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 976.307173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.307250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.307596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.308044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.308313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.308479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.309447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.309447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.309447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.814960] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.815444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.818028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.818028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.818028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be updated. [ 976.856256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.856256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.856256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.856256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.856256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.867309] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: IN_PROGRESS for 2s [ 977.586284] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 977.586651] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec deletion is rescheduled due to dependency. [ 977.586651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.201481] env[65973]: INFO networking_nsxv3.common.synchronization [req-3baa310b-a90b-4b9d-b7be-f9032eb77f3d req-0df059d6-cd74-483f-914d-be0ff7b08db5 tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 978.202617] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 978.202968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.203139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.203213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.203539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.204359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.204359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.204359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.204359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.204359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.204359] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.636928] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-79 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.637284] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.637284] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.637515] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.637782] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.637939] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.638072] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.638293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.638489] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.638693] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.638812] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.638948] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.639022] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.639153] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.639230] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.639359] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.660489] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.660737] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.660888] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.661148] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-79" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.661519] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.661783] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.661942] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.662323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.662499] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac7c9d77-8742-4c5e-a245-3a641b74ad5d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.707989] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.708138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.708212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.708428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.708854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.709166] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.709291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.709357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.709525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.709748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.709888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 already deleted. [ 978.709961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.877810] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a575d40f-4efb-403b-a9bf-a1d03f827661 in Status: SUCCESS [ 978.877970] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 deletion is rescheduled due to dependency. [ 978.878047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.168843] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.169104] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.169285] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.169623] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.169796] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.169970] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port ac7c9d77-8742-4c5e-a245-3a641b74ad5d not found, creating... [ 979.170333] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.170621] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.170746] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.171061] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.171303] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.171637] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.171864] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.171992] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.172295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.172461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.172637] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: ac7c9d77-8742-4c5e-a245-3a641b74ad5d is going to be created. [ 979.195521] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.195720] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.195764] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.196116] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.196965] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.196965] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.923530] env[65973]: INFO networking_nsxv3.common.synchronization [req-3baa310b-a90b-4b9d-b7be-f9032eb77f3d req-ae6cb0d4-dd26-48f6-beff-f8cd4d4fcb7c service nova] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 979.923530] env[65973]: INFO networking_nsxv3.common.synchronization [req-3baa310b-a90b-4b9d-b7be-f9032eb77f3d req-ae6cb0d4-dd26-48f6-beff-f8cd4d4fcb7c service nova] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 979.923530] env[65973]: INFO networking_nsxv3.common.synchronization [req-3baa310b-a90b-4b9d-b7be-f9032eb77f3d req-ae6cb0d4-dd26-48f6-beff-f8cd4d4fcb7c service nova] Enqueued Resource ID: ac7c9d77-8742-4c5e-a245-3a641b74ad5d with Priority: HIGHEST for action port [ 979.923994] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_rules [ 979.924147] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 979.924244] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac7c9d77-8742-4c5e-a245-3a641b74ad5d with Priority: HIGHEST for action port [ 979.924527] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.924661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.924701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.924935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.924970] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.926481] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.926481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.926481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.926481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.926730] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.926777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.926857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.927080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.927203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.927319] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.928262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.928749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.930959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.930959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.930959] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac7c9d77-8742-4c5e-a245-3a641b74ad5d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.431793] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.432838] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.433049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.433487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac7c9d77-8742-4c5e-a245-3a641b74ad5d with status ACTIVE [ 980.433670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.433780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.433845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.434217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.434217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.434349] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.434419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.434514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.434628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.434736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.434878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.434973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.435033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.435174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.435242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.435328] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac7c9d77-8742-4c5e-a245-3a641b74ad5d is going to be updated. [ 980.471831] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.471831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.471831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.471831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.471831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.471831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac7c9d77-8742-4c5e-a245-3a641b74ad5d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.934268] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.033143] env[65973]: INFO networking_nsxv3.common.synchronization [req-1ca29c2e-f220-4309-a022-c8f16c137d34 req-f603ed7f-4414-409e-9dec-450d2cf1a1e6 tempest-ImagesTestJSON-1697320241 tempest-ImagesTestJSON-1697320241-project-member] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 981.033914] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGHEST for action security_group_members [ 981.037474] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.037617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.037706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.037977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.038277] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.038454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.038585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.038799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.039485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.039666] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.436435] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.436871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.436871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.436871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.437014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.437092] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 is going to be created. [ 981.468353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.468583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.468583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.468837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.468939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.479878] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: UNINITIALIZED for 2s [ 981.545153] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.545153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.545153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.545489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.545489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.545660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.545771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.546404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.546404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.546404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.546404] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be updated. [ 981.587081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.587081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.587081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.587081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.587081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.602381] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: IN_PROGRESS for 2s [ 983.494295] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: SUCCESS [ 983.494580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.494815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.495024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.495228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.495347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.495412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.495579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.495663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.495753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.495887] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.613666] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab67debe-f546-499b-8301-c37179fecdee in Status: SUCCESS [ 983.613666] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab67debe-f546-499b-8301-c37179fecdee deletion is rescheduled due to dependency. [ 983.613666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.002285] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.505166] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f771ba6a-073a-4849-9576-cace0561d5e9: rpc.has_security_group_logging(os_id): False [ 984.526556] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.526786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.526836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.527492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.527492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.527648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.527713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.527808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.528026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.528122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.528255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 is going to be created. [ 984.626922] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.627104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.627245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.627652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.627861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.645017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: IN_PROGRESS for 2s [ 984.953077] env[65973]: INFO networking_nsxv3.common.synchronization [req-10ad7e94-28c7-4062-be80-18c8405790ca req-c5c0696b-e1db-45c4-959a-01fa804c8d60 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 984.954364] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 984.957454] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.957684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.957783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.957934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.958477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.958477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.958477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.958477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.958820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.958820] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.462335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.462335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.462335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.462796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.462796] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 985.497671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.497862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.497915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.499623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.499623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.510475] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 986.101327] env[65973]: INFO networking_nsxv3.common.synchronization [req-4b0ac332-b016-40f7-a1af-d7e1284c3edb req-ce1e2355-6039-4e6d-afb1-2aac8b5d2f8b tempest-ServerRescueTestJSON-683211413 tempest-ServerRescueTestJSON-683211413-project-member] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 986.101327] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 986.101636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.101795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.101868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.102447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.102447] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.102447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.102665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.102718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.102797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.102907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.509544] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.509917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.510029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.510382] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.510724] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.511055] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.511055] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.511291] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.511458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.511677] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.511787] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.511888] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.511988] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.512125] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.512214] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.512351] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.547484] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.547690] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.547853] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.548187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.548586] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-bc882d00-9a38-4361-8f03-6928dd422d54 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.549225] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.549435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.549792] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.550027] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc882d00-9a38-4361-8f03-6928dd422d54',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.612092] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.612092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.612092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.612092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.612541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.612541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.612707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.612707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.612887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.612970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.613079] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e already deleted. [ 986.613166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.659408] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: SUCCESS [ 986.659635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.053032] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.053295] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.053478] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.053834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.053997] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.054166] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port bc882d00-9a38-4361-8f03-6928dd422d54 not found, creating... [ 987.054431] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.054584] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.054698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.054934] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.055093] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.055375] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.055529] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.055649] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.055851] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.055981] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.056129] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: bc882d00-9a38-4361-8f03-6928dd422d54 is going to be created. [ 987.078261] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.078575] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.078711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.079134] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.079441] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.079689] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.523278] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 987.523917] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 987.523917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.854944] env[65973]: INFO networking_nsxv3.common.synchronization [req-4b0ac332-b016-40f7-a1af-d7e1284c3edb req-85a1edfa-236d-496d-a625-baea7088576d service nova] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_rules [ 987.855074] env[65973]: INFO networking_nsxv3.common.synchronization [req-4b0ac332-b016-40f7-a1af-d7e1284c3edb req-85a1edfa-236d-496d-a625-baea7088576d service nova] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 987.855136] env[65973]: INFO networking_nsxv3.common.synchronization [req-4b0ac332-b016-40f7-a1af-d7e1284c3edb req-85a1edfa-236d-496d-a625-baea7088576d service nova] Enqueued Resource ID: bc882d00-9a38-4361-8f03-6928dd422d54 with Priority: HIGHEST for action port [ 987.857071] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_rules [ 987.857071] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 987.857071] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc882d00-9a38-4361-8f03-6928dd422d54 with Priority: HIGHEST for action port [ 987.857323] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.857323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.857323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.857548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.857628] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.858835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.858952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.859045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.859220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.859390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.859477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.859537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.860892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.860892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.860892] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.860892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc882d00-9a38-4361-8f03-6928dd422d54 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.860892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.861851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.861851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.861851] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc882d00-9a38-4361-8f03-6928dd422d54',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.891937] env[65973]: INFO networking_nsxv3.common.synchronization [None req-93398004-a050-4a14-ab75-395432528dc4 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 987.894039] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 987.894782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.894931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.894998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.895269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.896020] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.010762] env[65973]: INFO networking_nsxv3.common.synchronization [None req-01f3a334-3fe2-4aab-83cc-7f8bb7ffcb82 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 988.011581] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 988.012202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.012302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.363912] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.363912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.364229] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.365079] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc882d00-9a38-4361-8f03-6928dd422d54 with status ACTIVE [ 988.365477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.365900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.365900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.365900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.366089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.366676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.366676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.366676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.367354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.367540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.369662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.369662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.369662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.369925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.369973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.370146] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc882d00-9a38-4361-8f03-6928dd422d54 is going to be updated. [ 988.397456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.397456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.397456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.397456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.397456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.397456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc882d00-9a38-4361-8f03-6928dd422d54" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.424483] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.424483] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 already deleted. [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.424483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.424483] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.873370] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.946889] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.950959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.950959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.950959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.950959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.950959] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 already deleted. [ 988.950959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.375284] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.375466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.375552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.375768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.375874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.375984] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be created. [ 989.403697] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.404235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.404235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.404464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.404731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.416969] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: UNINITIALIZED for 2s [ 991.437415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 991.438116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.438377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.439047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.439047] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.439198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.440164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.440449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.440581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.440715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.440836] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.942844] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.943030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.943092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.943321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.943510] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.943606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.943641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.943800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.943889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.943976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.944139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.944232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.944327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.944433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.944647] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.944647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.944830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.944864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.944993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.944993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.945116] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.447918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcf87a61-c07f-4a06-b6bc-89ada25f6a9e: rpc.has_security_group_logging(os_id): False [ 992.474429] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.474882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.474882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.478181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.478181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.478181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.478181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.478910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.478910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.478910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.478910] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be created. [ 992.557080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.557328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.557374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.557576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.557768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.577116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 993.013464] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 993.013464] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 993.212910] env[65973]: INFO networking_nsxv3.common.synchronization [req-7bda799b-0124-4628-afc5-04067219dd32 req-3f4c6a85-4d27-4514-b0cb-613d067e2d73 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 993.215351] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 993.219023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.219023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.219023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.219023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.722648] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.783763] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.783979] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.784093] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.784366] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.785469] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.785469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.785469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.785469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.785469] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.786158] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.786158] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.786158] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.786158] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.786425] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.786425] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.786521] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.808483] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.808704] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.808872] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.809181] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.809669] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.809963] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.811037] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.811374] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.811513] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.224742] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.314549] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.314968] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.315223] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.315659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.315915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.316178] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 not found, creating... [ 994.316733] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.316840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.317058] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.317471] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.317692] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.318136] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.318429] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.318605] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.319012] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.319266] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.319482] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 is going to be created. [ 994.341861] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.342149] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.342290] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.342615] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.342846] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.343083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.593263] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 994.593522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.727416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.728094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.728094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.728094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.728094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.728094] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 994.756802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.756938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.757182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.757434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.757587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.767530] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 995.062363] env[65973]: INFO networking_nsxv3.common.synchronization [req-7bda799b-0124-4628-afc5-04067219dd32 req-7fcab159-191e-4a26-ae0f-53836244c784 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 995.062546] env[65973]: INFO networking_nsxv3.common.synchronization [req-7bda799b-0124-4628-afc5-04067219dd32 req-7fcab159-191e-4a26-ae0f-53836244c784 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 995.062736] env[65973]: INFO networking_nsxv3.common.synchronization [req-7bda799b-0124-4628-afc5-04067219dd32 req-7fcab159-191e-4a26-ae0f-53836244c784 service nova] Enqueued Resource ID: c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 with Priority: HIGHEST for action port [ 995.067062] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 995.067062] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 995.067062] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 with Priority: HIGHEST for action port [ 995.067062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.067062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.067062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.067062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.067062] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.067062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.067062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.067736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.067736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.067736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.067736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.067736] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.572918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.574150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.575681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 with status ACTIVE [ 995.575681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.575681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.575681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.577689] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.577689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.577689] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95 is going to be updated. [ 995.604336] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.604493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.604560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.605385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.605385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.605385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7d6ef6b-8ab9-4cb9-8033-cacd9c5f3a95" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.862587] env[65973]: INFO networking_nsxv3.common.synchronization [req-202cdd88-80cb-496e-b39a-b02e0216ff36 req-e3d25b90-9d50-444b-8e07-8a617c2b32ef tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 995.862587] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 995.862587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.862587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.862587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.862587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.863599] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.863599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.863599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.863599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.863599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.863599] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.369921] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.369921] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.369921] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 already deleted. [ 996.369921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.430804] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.430804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.430804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.430804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.431429] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.431886] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.432210] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.433144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.433144] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.433144] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.433428] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.433947] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.434498] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.434498] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.434498] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.434982] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.460988] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.460988] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.460988] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.460988] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-536" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.460988] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-f3598025-d4d6-4054-99f4-e6d5943e8879 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.460988] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.460988] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.460988] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.460988] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3598025-d4d6-4054-99f4-e6d5943e8879',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.780872] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 996.780872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.781433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.781433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.781645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.781645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.781834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.781935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.782126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.782190] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.964499] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.965019] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.966017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.966017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.966017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.966155] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port f3598025-d4d6-4054-99f4-e6d5943e8879 not found, creating... [ 996.966724] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.967274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.971433] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.971966] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.972309] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.973198] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.973198] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.973537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.975244] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.975244] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.975402] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: f3598025-d4d6-4054-99f4-e6d5943e8879 is going to be created. [ 996.996507] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.997049] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.998650] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.999047] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.999492] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.999576] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.284693] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.720324] env[65973]: INFO networking_nsxv3.common.synchronization [req-202cdd88-80cb-496e-b39a-b02e0216ff36 req-9cccc079-ae29-4b0d-b302-63e37290b704 service nova] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 997.720766] env[65973]: INFO networking_nsxv3.common.synchronization [req-202cdd88-80cb-496e-b39a-b02e0216ff36 req-9cccc079-ae29-4b0d-b302-63e37290b704 service nova] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 997.720766] env[65973]: INFO networking_nsxv3.common.synchronization [req-202cdd88-80cb-496e-b39a-b02e0216ff36 req-9cccc079-ae29-4b0d-b302-63e37290b704 service nova] Enqueued Resource ID: f3598025-d4d6-4054-99f4-e6d5943e8879 with Priority: HIGHEST for action port [ 997.721590] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_rules [ 997.721736] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 997.721851] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3598025-d4d6-4054-99f4-e6d5943e8879 with Priority: HIGHEST for action port [ 997.722307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.722404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.722586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.722715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.723087] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.725084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.725412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.725412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.725628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.725628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.726204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.726204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.726204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.726204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.726204] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.726996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3598025-d4d6-4054-99f4-e6d5943e8879 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.727218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.727287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.727923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.727923] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3598025-d4d6-4054-99f4-e6d5943e8879',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.787541] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.227124] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.227480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.229693] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.230795] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3598025-d4d6-4054-99f4-e6d5943e8879 with status ACTIVE [ 998.232424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.232639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.232754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.233082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.237186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.237420] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.237544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.237611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.237807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.237897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238249] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.238363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.238428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.238610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.238737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.238772] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3598025-d4d6-4054-99f4-e6d5943e8879 is going to be updated. [ 998.265840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.265840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.265840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.265840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.265840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.265840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3598025-d4d6-4054-99f4-e6d5943e8879" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.292589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.292589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.292589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.292589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.292589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.292589] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 998.485960] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.485960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.485960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.485960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.485960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.506045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 998.740757] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.243293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.243585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.243642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.243833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.243952] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.244095] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 is going to be created. [ 999.274243] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.274547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.274692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.275179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.275936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.289078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: UNINITIALIZED for 2s [ 1000.520118] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1000.520442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.520582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.520827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.521037] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.521160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.521243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.521414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.521496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.521583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.521670] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.026834] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.026834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.026834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.027070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.027201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.027322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.027357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.027751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.027751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.028688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.028688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.028688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.028688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.028688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.029240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.029240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.030930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.030930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.030930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.031063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.031063] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.304032] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: SUCCESS [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.304032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.304032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.304032] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.533913] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 1001.553375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.553582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.553582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.554049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.554049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.554152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.554213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.554253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.554385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.554463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.554661] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.554751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.554812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.554958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.555048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.555397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.555523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.555591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.555833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.556031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.556031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1001.625314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.625458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.625519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.625743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.625893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.643322] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1001.814403] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.318487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5c35fe-01e4-45c6-b69d-55e67887ab22: rpc.has_security_group_logging(os_id): False [ 1002.339063] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.339298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.339298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.339516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.339679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.339853] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.340012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.340065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.340216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.340304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.340384] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 is going to be created. [ 1002.406186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.406427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.406427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.406630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.406820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.420540] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: IN_PROGRESS for 2s [ 1002.722533] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.722871] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1003.663618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1003.663892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.995487] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9ad77cf6-b44c-4aa1-bffa-041b7dfde79b None None] Enqueued Resource ID: c06976be-d184-479d-8bcb-6147fbd72dd7 with Priority: HIGHEST for action port [ 1003.996448] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06976be-d184-479d-8bcb-6147fbd72dd7 with Priority: HIGHEST for action port [ 1003.997076] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c06976be-d184-479d-8bcb-6147fbd72dd7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.997217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c06976be-d184-479d-8bcb-6147fbd72dd7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.997271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c06976be-d184-479d-8bcb-6147fbd72dd7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.997728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c06976be-d184-479d-8bcb-6147fbd72dd7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.999023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c06976be-d184-479d-8bcb-6147fbd72dd7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.434356] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: SUCCESS [ 1004.434732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.501131] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c06976be-d184-479d-8bcb-6147fbd72dd7 [ 1004.501577] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.501773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.501860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.502292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.502292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.502439] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c06976be-d184-479d-8bcb-6147fbd72dd7 already deleted. [ 1004.502545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c06976be-d184-479d-8bcb-6147fbd72dd7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.634356] env[65973]: INFO networking_nsxv3.common.synchronization [None req-af9977a3-0af1-4639-b7f0-1319eed619f1 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1004.637177] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1004.638623] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.638623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.638623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.638623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.638623] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.797999] env[65973]: INFO networking_nsxv3.common.synchronization [None req-89cd3ebc-e2ea-4554-bdbd-fb20751090bd tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1004.797999] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1004.797999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.799670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.162973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.163338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.163338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.163537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.163597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.163708] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b already deleted. [ 1005.163833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.164023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.164232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.164391] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.689783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.689783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.689783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.689783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.689783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.689783] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b already deleted. [ 1005.689783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.842839] env[65973]: INFO networking_nsxv3.common.synchronization [req-8e6c6bb1-2da3-4e85-8f9b-9efbff8ce40d req-af000782-f814-401e-87f6-3327834cac32 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1005.843416] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1005.843740] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.843894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.843953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.844294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.844503] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.844639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.844707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.844876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.844962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.845070] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.281975] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.281975] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.281975] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.281975] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.282590] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.282650] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.283546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.283546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.283546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.284572] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.284572] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.284572] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.284572] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.284572] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.284572] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.284572] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.308888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.309376] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.309618] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.310151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.310864] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-baa992bd-f5dc-431a-8615-4b748898738c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.311405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.311613] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.312293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.312435] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baa992bd-f5dc-431a-8615-4b748898738c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.347297] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.347525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.347578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.347781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.347917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.350193] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.350193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.350193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.350193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.350193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.350193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 already deleted. [ 1006.350193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.759662] env[65973]: INFO networking_nsxv3.common.synchronization [None req-cd790809-73c5-4b0a-98f2-17c2e178c5a3 None None] Enqueued Resource ID: c16ccac8-e783-4a1f-a2e9-8447e6116ae9 with Priority: HIGHEST for action port [ 1006.760899] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16ccac8-e783-4a1f-a2e9-8447e6116ae9 with Priority: HIGHEST for action port [ 1006.761379] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c16ccac8-e783-4a1f-a2e9-8447e6116ae9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.761693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c16ccac8-e783-4a1f-a2e9-8447e6116ae9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.761850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c16ccac8-e783-4a1f-a2e9-8447e6116ae9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.762180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c16ccac8-e783-4a1f-a2e9-8447e6116ae9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.762304] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16ccac8-e783-4a1f-a2e9-8447e6116ae9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.818027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.818027] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port baa992bd-f5dc-431a-8615-4b748898738c not found, creating... [ 1006.818027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.818027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.818595] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.818595] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.818595] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.818793] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.818982] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.819480] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: baa992bd-f5dc-431a-8615-4b748898738c is going to be created. [ 1006.841951] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.842247] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.842391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.843276] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.843549] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.843785] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.088891] env[65973]: INFO networking_nsxv3.common.synchronization [None req-f76b3834-35e1-4c13-a1f5-dbcd940a0bd6 None None] Enqueued Resource ID: 4cb2a25d-db8d-4a67-b0cd-f787dde7811b with Priority: HIGHEST for action port [ 1007.089497] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb2a25d-db8d-4a67-b0cd-f787dde7811b with Priority: HIGHEST for action port [ 1007.092034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cb2a25d-db8d-4a67-b0cd-f787dde7811b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.092341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cb2a25d-db8d-4a67-b0cd-f787dde7811b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.092512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cb2a25d-db8d-4a67-b0cd-f787dde7811b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.092902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cb2a25d-db8d-4a67-b0cd-f787dde7811b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.093051] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cb2a25d-db8d-4a67-b0cd-f787dde7811b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.264373] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c16ccac8-e783-4a1f-a2e9-8447e6116ae9 [ 1007.264606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.264742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.264899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.265161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.265267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.265351] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c16ccac8-e783-4a1f-a2e9-8447e6116ae9 already deleted. [ 1007.265437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c16ccac8-e783-4a1f-a2e9-8447e6116ae9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.480619] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.481127] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.551877] env[65973]: INFO networking_nsxv3.common.synchronization [req-8e6c6bb1-2da3-4e85-8f9b-9efbff8ce40d req-cff9cf70-df84-4208-a89b-853980d3db7a service nova] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 1007.552065] env[65973]: INFO networking_nsxv3.common.synchronization [req-8e6c6bb1-2da3-4e85-8f9b-9efbff8ce40d req-cff9cf70-df84-4208-a89b-853980d3db7a service nova] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1007.552206] env[65973]: INFO networking_nsxv3.common.synchronization [req-8e6c6bb1-2da3-4e85-8f9b-9efbff8ce40d req-cff9cf70-df84-4208-a89b-853980d3db7a service nova] Enqueued Resource ID: baa992bd-f5dc-431a-8615-4b748898738c with Priority: HIGHEST for action port [ 1007.552712] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_rules [ 1007.552861] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1007.552941] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa992bd-f5dc-431a-8615-4b748898738c with Priority: HIGHEST for action port [ 1007.556966] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.556966] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.556966] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.556966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.556966] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.557402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.557402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.557402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.557402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.557402] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.561184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-baa992bd-f5dc-431a-8615-4b748898738c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.561310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.561310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.561500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.561558] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baa992bd-f5dc-431a-8615-4b748898738c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.595203] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cb2a25d-db8d-4a67-b0cd-f787dde7811b [ 1007.595467] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.595610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.595690] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.595964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.596078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.596213] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cb2a25d-db8d-4a67-b0cd-f787dde7811b already deleted. [ 1007.596364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cb2a25d-db8d-4a67-b0cd-f787dde7811b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.062896] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.064060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.064292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.064543] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baa992bd-f5dc-431a-8615-4b748898738c with status ACTIVE [ 1008.064699] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.064797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.064863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.065075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.065167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.065340] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.065466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.065627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.065627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.065752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.065875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.065962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.067037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.067037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.067227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.067227] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baa992bd-f5dc-431a-8615-4b748898738c is going to be updated. [ 1008.091198] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.091198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.091198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.091198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.091198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.094528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baa992bd-f5dc-431a-8615-4b748898738c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.491510] env[65973]: INFO networking_nsxv3.common.synchronization [req-b1f9fba5-caba-418c-a0f9-768b635249e0 req-c6132a91-09b3-42f2-95bd-50b2c20c9627 tempest-ServersTestBootFromVolume-26785003 tempest-ServersTestBootFromVolume-26785003-project-member] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1008.492078] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1008.492424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.492519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.492581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.492856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.493165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.493248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.493304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.493467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.493565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.493687] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.565731] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.873024] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.873024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-68" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.873024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-68" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.873024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-68" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.873024] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.873024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.873024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.873443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.873443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.873572] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.873679] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.873789] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.873893] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.874072] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.874193] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.874316] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.894828] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.895039] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.895188] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.895372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-68" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.895683] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-8e003c4a-1f03-4c55-9953-d334c79632c3 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.895853] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.895971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.896323] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.896457] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e003c4a-1f03-4c55-9953-d334c79632c3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.996286] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.997099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.997264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.997496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.997592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.997803] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.997906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.997986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.998160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.998234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.998330] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 already deleted. [ 1008.998412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.073470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.073470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.073470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.073470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.073470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.073470] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 is going to be created. [ 1009.096335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.096573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.096648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.096916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.097061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.106895] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: UNINITIALIZED for 2s [ 1009.401573] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.401573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.401573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.401573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.401573] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.401933] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 8e003c4a-1f03-4c55-9953-d334c79632c3 not found, creating... [ 1009.402216] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.402363] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.402482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.402737] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.402901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.403243] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.403398] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.403531] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.403741] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.403881] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.404127] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 8e003c4a-1f03-4c55-9953-d334c79632c3 is going to be created. [ 1009.425085] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.425382] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.425515] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.425788] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.426033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.426285] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.597100] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ba618bee-3b50-49f2-b856-94634a780301 None None] Enqueued Resource ID: 165ed8d6-b027-425a-b561-81efcb7182ec with Priority: HIGHEST for action port [ 1009.597100] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 165ed8d6-b027-425a-b561-81efcb7182ec with Priority: HIGHEST for action port [ 1009.597100] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-165ed8d6-b027-425a-b561-81efcb7182ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.597100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-165ed8d6-b027-425a-b561-81efcb7182ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.597100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-165ed8d6-b027-425a-b561-81efcb7182ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.597100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-165ed8d6-b027-425a-b561-81efcb7182ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.597100] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('165ed8d6-b027-425a-b561-81efcb7182ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.100374] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 165ed8d6-b027-425a-b561-81efcb7182ec [ 1010.100633] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.100854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.100919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.101137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.101247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.101346] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:165ed8d6-b027-425a-b561-81efcb7182ec already deleted. [ 1010.101442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-165ed8d6-b027-425a-b561-81efcb7182ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.248163] env[65973]: INFO networking_nsxv3.common.synchronization [req-b1f9fba5-caba-418c-a0f9-768b635249e0 req-47357fe8-e328-40c4-9caf-fdd7a6d00e9f service nova] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 1010.248374] env[65973]: INFO networking_nsxv3.common.synchronization [req-b1f9fba5-caba-418c-a0f9-768b635249e0 req-47357fe8-e328-40c4-9caf-fdd7a6d00e9f service nova] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1010.248546] env[65973]: INFO networking_nsxv3.common.synchronization [req-b1f9fba5-caba-418c-a0f9-768b635249e0 req-47357fe8-e328-40c4-9caf-fdd7a6d00e9f service nova] Enqueued Resource ID: 8e003c4a-1f03-4c55-9953-d334c79632c3 with Priority: HIGHEST for action port [ 1010.250017] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_rules [ 1010.250560] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1010.254071] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e003c4a-1f03-4c55-9953-d334c79632c3 with Priority: HIGHEST for action port [ 1010.255118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.255298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.255375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.256329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.256329] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.257289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.257446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.257543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.259366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.259366] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.259366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.259938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.259938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.259938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.260073] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.261739] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e003c4a-1f03-4c55-9953-d334c79632c3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.261882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.261941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.262450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.262450] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e003c4a-1f03-4c55-9953-d334c79632c3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.758762] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.758762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.764933] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e003c4a-1f03-4c55-9953-d334c79632c3 with status ACTIVE [ 1010.764933] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.764933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.764933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.764933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.764933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.765367] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.766146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.766146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.766146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.766146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.766322] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.766322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.766696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.766898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.767106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.767230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e003c4a-1f03-4c55-9953-d334c79632c3 is going to be updated. [ 1010.768530] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.792179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.792359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.792423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.792590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.792725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.792881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e003c4a-1f03-4c55-9953-d334c79632c3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.120355] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: SUCCESS [ 1011.120638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.120857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.121182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.121482] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.121777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.121866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.122081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.122187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.122336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.122497] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.271783] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.624952] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.775320] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.775665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.775665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.775773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.776401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.776401] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 is going to be created. [ 1011.802163] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.802398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.802535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.802785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.802965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.817217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: UNINITIALIZED for 2s [ 1011.944951] env[65973]: INFO networking_nsxv3.common.synchronization [req-5f2f85d2-a9db-4caf-bee4-8a378c0631b5 req-f5cf7e01-194d-4c0e-afa4-8a1e6af6728c tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1011.945588] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1011.945937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.946118] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.946214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.946428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.946592] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.946695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.946758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.946913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.947053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.947198] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.127052] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b456c0-ca3e-4dcf-883f-c2038bcc8151: rpc.has_security_group_logging(os_id): False [ 1012.149872] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.150072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.150072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.150264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.150358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.150611] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.151186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.151186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.151186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.151186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.151384] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 is going to be created. [ 1012.229315] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.231836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.231836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.231836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.231836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.241456] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: IN_PROGRESS for 2s [ 1012.331274] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.331518] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.331657] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.332025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.333340] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.333554] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.333713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.334017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.334241] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.334522] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.334644] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.334787] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.334907] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.335073] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.335130] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.335304] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.360451] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.360657] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.360819] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.361054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.361611] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-792c528e-70fb-4018-bb6e-80cdd657577a taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.361611] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.361777] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.362155] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.362256] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792c528e-70fb-4018-bb6e-80cdd657577a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.450045] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.450045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.450045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.450276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.450276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.450375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.450513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.450598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.450762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.450877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.451301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1012.483686] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.483895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.483972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.484206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.494843] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1012.864724] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.865152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.865152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.865438] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.865586] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.865741] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 792c528e-70fb-4018-bb6e-80cdd657577a not found, creating... [ 1012.866016] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.866221] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.866356] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.866584] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.866761] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.867164] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.867370] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.867583] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.867872] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.868079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.868387] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 792c528e-70fb-4018-bb6e-80cdd657577a is going to be created. [ 1012.889555] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.889761] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.889879] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.890224] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.890440] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.890678] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.937394] env[65973]: INFO networking_nsxv3.common.synchronization [req-c7e17a8f-be53-49ad-bb52-4edc5bcef589 req-6bfe3b14-fe1c-4634-a3ef-71ad5e9378db tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1012.938718] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1012.938718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.938718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.938718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.939029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.939073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.939410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.939410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.939410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.939689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.939689] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.222255] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.222445] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.222564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.222855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.223202] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.223376] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.223493] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.223717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.223862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.224099] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.224262] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.224373] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.224478] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.224583] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.224685] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.224814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.246200] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.246339] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.246483] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.246684] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.247050] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-45175df2-da0e-4e9b-94c5-bfaef04d57d8 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.247240] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.247360] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.247700] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.247848] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45175df2-da0e-4e9b-94c5-bfaef04d57d8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.441856] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.442055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.442146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.442333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.442412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.442620] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.442715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.442773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.442924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.443009] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.443104] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea already deleted. [ 1013.443178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.597838] env[65973]: INFO networking_nsxv3.common.synchronization [req-5f2f85d2-a9db-4caf-bee4-8a378c0631b5 req-d3dc6a61-8f7f-4db9-b44e-a9548bdf4342 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1013.598154] env[65973]: INFO networking_nsxv3.common.synchronization [req-5f2f85d2-a9db-4caf-bee4-8a378c0631b5 req-d3dc6a61-8f7f-4db9-b44e-a9548bdf4342 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1013.600711] env[65973]: INFO networking_nsxv3.common.synchronization [req-5f2f85d2-a9db-4caf-bee4-8a378c0631b5 req-d3dc6a61-8f7f-4db9-b44e-a9548bdf4342 service nova] Enqueued Resource ID: 792c528e-70fb-4018-bb6e-80cdd657577a with Priority: HIGHEST for action port [ 1013.606026] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1013.606026] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1013.606026] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792c528e-70fb-4018-bb6e-80cdd657577a with Priority: HIGHEST for action port [ 1013.606026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.606026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.606535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.606535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.606535] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.611804] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.611804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.612328] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-792c528e-70fb-4018-bb6e-80cdd657577a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.612512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.612604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.613176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.613176] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792c528e-70fb-4018-bb6e-80cdd657577a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.750221] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.750538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.750681] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.751036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.751269] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.751452] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 45175df2-da0e-4e9b-94c5-bfaef04d57d8 not found, creating... [ 1013.751765] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.751964] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.752148] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.752478] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.752677] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.753107] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.753340] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.753500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.753766] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.753944] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.754124] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 45175df2-da0e-4e9b-94c5-bfaef04d57d8 is going to be created. [ 1013.789479] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.789710] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.789805] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.790153] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.790741] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.791274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.830690] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: SUCCESS [ 1013.830936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.831136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.831418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.831596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.831720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.831885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.831949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.832044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.832137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.832229] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.021737] env[65973]: INFO networking_nsxv3.common.synchronization [req-c6b77419-779c-44d4-99d8-85180909a612 req-d21c9c7f-1ebc-4c5a-a34d-fe9177a91f6b tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1014.022366] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1014.022711] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.022853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.022917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.023430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.023430] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.023430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.023633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.023633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.023746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.023797] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.117327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.117327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.117429] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 792c528e-70fb-4018-bb6e-80cdd657577a with status ACTIVE [ 1014.117589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.117903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.117903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.118092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.118092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.118230] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.118324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.118380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.118547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.118631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.118823] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.118926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.118993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.119124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.119856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.119856] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 792c528e-70fb-4018-bb6e-80cdd657577a is going to be updated. [ 1014.143143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.143326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.143400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.143619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.143757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.143924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-792c528e-70fb-4018-bb6e-80cdd657577a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.256437] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: SUCCESS [ 1014.256653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.336959] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.504719] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1014.504866] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec deletion is rescheduled due to dependency. [ 1014.504987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.505161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.505384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.505566] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.505684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.505744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.505906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.505976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.506085] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.509255] env[65973]: INFO networking_nsxv3.common.synchronization [req-c7e17a8f-be53-49ad-bb52-4edc5bcef589 req-fbec2930-3bdd-4deb-b651-7796047ced27 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1014.509255] env[65973]: INFO networking_nsxv3.common.synchronization [req-c7e17a8f-be53-49ad-bb52-4edc5bcef589 req-fbec2930-3bdd-4deb-b651-7796047ced27 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1014.509255] env[65973]: INFO networking_nsxv3.common.synchronization [req-c7e17a8f-be53-49ad-bb52-4edc5bcef589 req-fbec2930-3bdd-4deb-b651-7796047ced27 service nova] Enqueued Resource ID: 45175df2-da0e-4e9b-94c5-bfaef04d57d8 with Priority: HIGHEST for action port [ 1014.509255] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1014.510302] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1014.510302] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45175df2-da0e-4e9b-94c5-bfaef04d57d8 with Priority: HIGHEST for action port [ 1014.510302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.510302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.510302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.510302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.510915] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.511601] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.511601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.511601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.511831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.511961] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.512069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.512149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.512285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.512356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.513115] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.513977] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-45175df2-da0e-4e9b-94c5-bfaef04d57d8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.513977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.514170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.514222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.514277] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45175df2-da0e-4e9b-94c5-bfaef04d57d8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.525375] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.839847] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79821cdf-baef-439f-bc9f-8fb2227beed1: rpc.has_security_group_logging(os_id): False [ 1014.859058] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.859300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.859300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.859543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.859651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.859931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.860053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.860115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.860293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.860369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.860452] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 is going to be created. [ 1014.924560] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.924560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.924560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.924787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.924915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.937913] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: IN_PROGRESS for 2s [ 1015.009922] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.015882] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.016087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.016211] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.017085] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45175df2-da0e-4e9b-94c5-bfaef04d57d8 with status ACTIVE [ 1015.017303] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.017973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.017973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.017973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.017973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.017973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.018299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.018299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.018299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.018411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.018526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.018618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.018722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.018846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.018929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.019238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45175df2-da0e-4e9b-94c5-bfaef04d57d8 is going to be updated. [ 1015.027456] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.043634] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.043834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.043893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.044150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.044364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.044483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45175df2-da0e-4e9b-94c5-bfaef04d57d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.506321] env[65973]: INFO networking_nsxv3.common.synchronization [req-9bb9c253-1970-4a01-9b51-2f1ded90d5b9 req-940f2e6b-d1de-4c42-890c-df7c51f40930 tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 1015.506463] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 1015.506709] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.506825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.506888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.508400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.508589] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.508715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.508799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.508985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.509161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.509270] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.512541] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.522329] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.530574] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.530748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.530863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.532029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.532029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.532029] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1015.568113] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.568270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.568270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.570288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.570288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.580870] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1016.012422] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.013989] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.014163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.014285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.014470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.014561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.014663] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1016.026430] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.026430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.026587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.026699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.026793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.027090] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be created. [ 1016.044142] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.044474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.044474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.044559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.044701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.053350] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.053484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.053758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.053818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.053949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.056630] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1016.070620] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: UNINITIALIZED for 2s [ 1016.515047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.951472] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: SUCCESS [ 1016.951700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.017518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.017751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.017832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.018116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.018214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.018322] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 1017.050204] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.050507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.050507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.050755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.050995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.061686] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 1017.593658] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1017.593958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.073278] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1018.073643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.073643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.074240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.074240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.074240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.074463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.074463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.074537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.074663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.074700] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.080099] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1018.080319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.080602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.080693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.080934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.081095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.081184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.081358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.081441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.081528] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.081644] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.578047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.584107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.584275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.584275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.584502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.584697] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.584801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.584891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.585070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.585156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.585247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.585401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.585730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.585730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.585730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.585891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.585963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.586017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.586130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.586204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.586278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.586366] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.073158] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 1019.073874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.080937] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a7ed067-ae07-49f5-b03a-aa95774538ec: rpc.has_security_group_logging(os_id): False [ 1019.089881] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9b235ba-8426-4bfa-b2c5-84500087d8ea: rpc.has_security_group_logging(os_id): False [ 1019.101706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.101931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.101931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.102233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.102233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102574] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.102715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.102715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.102904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.102974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.103103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1019.106912] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.107440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.107440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.107440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.107440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.107670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.107670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.107764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.107828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.108070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.108158] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.108228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.108386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.108471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.108556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.108685] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.108785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.108841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.109016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.109090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.109180] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be created. [ 1019.186188] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.186188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.186188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.186188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.186188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.188209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.188356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.188356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.188480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.188646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.204017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1019.205012] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1020.277558] env[65973]: INFO networking_nsxv3.common.synchronization [req-89ed5549-b437-44b0-939d-4c0e715da4b3 req-5af26f0d-da0a-4d93-ade2-fa4b45c706a3 tempest-ServerActionsV293TestJSON-334095518 tempest-ServerActionsV293TestJSON-334095518-project-member] Enqueued Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 1020.277558] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b with Priority: HIGHEST for action security_group_members [ 1020.277902] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-3639d272-10a3-4e14-b0d6-0d00cd61092b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.277902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.277902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.278108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.278265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.278402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.278478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.278575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.278663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.278772] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3639d272-10a3-4e14-b0d6-0d00cd61092b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.779953] env[65973]: INFO networking_nsxv3.common.synchronization [None req-ac6b518b-07c0-4383-bd57-93aafccd8a98 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b with Priority: HIGHEST for action security_group_rules [ 1020.780529] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b with Priority: HIGHEST for action security_group_rules [ 1020.781341] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.783480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.783557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.784360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.784513] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e071aee-4d8a-4420-b7ad-490f52f8b45b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.785566] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.785694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.785746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.785918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.786713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.786713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.786713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.786997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.786997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.787232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.787519] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b is going to be updated. [ 1020.821029] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.821029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.821029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.821029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.821029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.831545] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: IN_PROGRESS for 2s [ 1020.876952] env[65973]: INFO networking_nsxv3.common.synchronization [None req-baf1466d-5f8a-493f-a284-ab4d6cfe0c7d tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b with Priority: HIGHEST for action security_group_rules [ 1020.877547] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b with Priority: HIGHEST for action security_group_rules [ 1020.877970] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.877970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.222826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1021.223082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.223879] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1021.224094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.317240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.319037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.319171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.319666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.319666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.319666] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b already deleted. [ 1021.319847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.320569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.320734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.320914] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e071aee-4d8a-4420-b7ad-490f52f8b45b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.844735] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.844883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.844955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.845195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.845288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.845390] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e071aee-4d8a-4420-b7ad-490f52f8b45b already deleted. [ 1021.845472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e071aee-4d8a-4420-b7ad-490f52f8b45b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.469882] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f0a1fc6-14e1-4feb-96a7-fd05f16ed966 req-8d36347c-a1d7-4897-81b1-bd6ecaeaf934 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1022.470442] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1022.471041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.471169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.471250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.471426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.471576] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.471672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.471733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.472922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.472922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.472922] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.844565] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b in Status: SUCCESS [ 1022.844565] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3639d272-10a3-4e14-b0d6-0d00cd61092b deletion is rescheduled due to dependency. [ 1022.844565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3639d272-10a3-4e14-b0d6-0d00cd61092b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.978018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.978018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.978018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.978018] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1023.007973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.007973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.007973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.008214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.008386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.020427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1023.034802] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.035102] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.035206] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.035502] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.036541] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.036541] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.036541] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.036541] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.036868] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.036952] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.037167] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.037258] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.037383] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.037512] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.037634] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.037804] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.058145] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.058322] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.058478] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.058666] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.058998] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-b143bccb-6158-44dd-995c-da8cb57032d8 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.059187] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.059647] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.059918] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.060187] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b143bccb-6158-44dd-995c-da8cb57032d8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.562511] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.562896] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.563031] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.563296] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.563487] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.563664] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port b143bccb-6158-44dd-995c-da8cb57032d8 not found, creating... [ 1023.563997] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.564213] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.564351] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.564610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.564771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.565171] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.565367] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.565502] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.565904] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.565904] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.566060] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: b143bccb-6158-44dd-995c-da8cb57032d8 is going to be created. [ 1023.590543] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.590771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.590987] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.591345] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.591603] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.591855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.254881] env[65973]: INFO networking_nsxv3.common.synchronization [req-f34e2706-d748-42e4-bb31-f9db90712394 req-71c59690-6e35-40aa-afe5-0109fda3299f tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1024.255500] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1024.255763] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.255901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.255954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.256170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.256324] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.256609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.256609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.256609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.256797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.256797] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.346418] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f0a1fc6-14e1-4feb-96a7-fd05f16ed966 req-0ed5770b-4e87-4f8b-a415-92969fb1769f service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 1024.346671] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f0a1fc6-14e1-4feb-96a7-fd05f16ed966 req-0ed5770b-4e87-4f8b-a415-92969fb1769f service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1024.346773] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f0a1fc6-14e1-4feb-96a7-fd05f16ed966 req-0ed5770b-4e87-4f8b-a415-92969fb1769f service nova] Enqueued Resource ID: b143bccb-6158-44dd-995c-da8cb57032d8 with Priority: HIGHEST for action port [ 1024.349041] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 1024.349041] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1024.349041] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b143bccb-6158-44dd-995c-da8cb57032d8 with Priority: HIGHEST for action port [ 1024.349041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349041] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.357119] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.357119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.357420] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b143bccb-6158-44dd-995c-da8cb57032d8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.357561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.357642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.357907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.358039] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b143bccb-6158-44dd-995c-da8cb57032d8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.758956] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.758956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.758956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.759795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.759795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.759795] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.759795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.759795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.759993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.760064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.760157] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1024.793299] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.793763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.793856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.794142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.794209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.806620] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1024.859655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.859795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.862339] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b143bccb-6158-44dd-995c-da8cb57032d8 with status ACTIVE [ 1024.862557] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.862759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.862842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.863016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.863095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.863278] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.863369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.863439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.864205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.864205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.864676] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b143bccb-6158-44dd-995c-da8cb57032d8 is going to be updated. [ 1024.886540] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.886682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.886945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.887053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.887206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.887385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b143bccb-6158-44dd-995c-da8cb57032d8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.031393] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1025.031527] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 1025.031640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.031802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.032074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.032292] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.032479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.032576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.032750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.032832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.032927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.536739] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.038774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.541718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.541887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.541971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.542228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.542320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.542423] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1026.575025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.575025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.575295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.575341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.575516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.587608] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1026.819872] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1026.819872] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 1026.819872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.941752] env[65973]: INFO networking_nsxv3.common.synchronization [req-11e6745d-5a17-4f69-b9c0-23b38d2e2739 req-53c33392-fbb8-41bf-bb26-345265aaf589 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1026.941991] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1026.942596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.942978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.943253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.943765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.944101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.944332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.944477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.944730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.946022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.946022] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.259506] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.259835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.259835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.260366] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.260662] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.260824] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.261027] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.261291] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.261430] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.261669] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.261785] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.261992] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.262202] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.262365] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.262482] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.262616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.291577] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.291852] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.292045] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.292241] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-981" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.292578] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.292768] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.292917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.293310] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.293473] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c89e77-71c1-44e2-baa0-2c6d76b4fa8d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.447237] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.447401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.447469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.447706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.447801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.447999] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.448210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.448316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.449031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.449031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.449031] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b already deleted. [ 1027.449031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.795660] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.795944] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.796126] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.796458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.796659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.796848] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d not found, creating... [ 1027.797154] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.797373] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.797525] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.797792] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.797966] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.798317] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.798526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.798685] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.798990] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.799191] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.799349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d is going to be created. [ 1027.820165] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.820410] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.820533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.820954] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.821265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.821610] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.500940] env[65973]: INFO networking_nsxv3.common.synchronization [req-272730c1-9578-4e33-98c6-e2f02e497ec5 req-70db7c06-94d9-47db-9ea8-7b6e57b1841f tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1028.501551] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1028.501859] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.502037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.502147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.503033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.503033] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.503033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.503033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.503033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.503033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.503033] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.565194] env[65973]: INFO networking_nsxv3.common.synchronization [req-11e6745d-5a17-4f69-b9c0-23b38d2e2739 req-100602bf-c73e-4caf-ba38-e106eaf0473a service nova] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1028.565194] env[65973]: INFO networking_nsxv3.common.synchronization [req-11e6745d-5a17-4f69-b9c0-23b38d2e2739 req-100602bf-c73e-4caf-ba38-e106eaf0473a service nova] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1028.567030] env[65973]: INFO networking_nsxv3.common.synchronization [req-11e6745d-5a17-4f69-b9c0-23b38d2e2739 req-100602bf-c73e-4caf-ba38-e106eaf0473a service nova] Enqueued Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1028.567638] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1028.567768] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1028.567861] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1028.568199] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.568337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.568416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.568925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.569737] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.571051] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.571608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.571608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.571866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.571970] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.572268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.572268] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.576026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.576026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.576026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.576026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.576026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.576026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.576026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.576026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c89e77-71c1-44e2-baa0-2c6d76b4fa8d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.598931] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1028.599177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.599339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.599554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.599766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.599928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.600037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.600230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.600339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.600792] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.600792] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.004717] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.004942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.004942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.005316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.005414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.005953] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.006093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.006163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.006330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.006416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.006506] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1029.032508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.032701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.032701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.032863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.033070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.042757] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1029.077287] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with status ACTIVE [ 1029.077555] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.077683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.077751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.077979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.078089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.078276] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.078374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.078441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.078597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.078675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.078857] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.078949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.079293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.079293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.079293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.079293] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d is going to be updated. [ 1029.080379] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.081347] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.081460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.102499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.102708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.102708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.102919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.103067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.103331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.104908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.104981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.105214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.105629] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.105629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.105629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.105804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.105804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.105879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.106042] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.106175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.106243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.106394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.106534] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.106628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.106687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.106851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.106934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.107028] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.107119] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.499427] env[65973]: INFO networking_nsxv3.common.synchronization [req-913d19da-211e-4b97-98e7-654294b56ca5 req-b24ec4c4-9b33-4989-a7ce-4e6d74e6e16a tempest-ServersNegativeTestJSON-1329693835 tempest-ServersNegativeTestJSON-1329693835-project-member] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1029.499962] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1029.500287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.500442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.500515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.500739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.500926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.501079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.501433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.501433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.501433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.501433] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.583214] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.609231] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 1029.627637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.627806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.627864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.628095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.628344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.628433] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.628492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.628529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.628672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.628739] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.628956] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.629080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.629736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.629736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.629736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.629736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.629736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.629736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.629991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.629991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.629991] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1029.719422] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.719573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.719640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.719863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.720036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.747671] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1029.824442] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.824731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.824731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.824991] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.825325] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.825512] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.825602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.825849] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.825997] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.826224] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.826330] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.826433] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.826535] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.826638] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.826740] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.826895] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.850178] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.850357] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.850483] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.850660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.851050] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.851242] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.851359] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.851708] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.851847] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f9d4a6-ecf6-468e-98b8-d9b4c64dea91',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.003524] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.003718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.003791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.003990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.004099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.004296] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.004397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.004460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.004620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.004697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.004779] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 already deleted. [ 1030.004859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.085949] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.085949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.085949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.086782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.086782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.086782] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be created. [ 1030.114394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.114730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.114730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.114891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.115070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.125561] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: UNINITIALIZED for 2s [ 1030.357329] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.357329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.357329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.357329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.357329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.357329] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 not found, creating... [ 1030.357329] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.357329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.357806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.357806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.357893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.359067] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.359067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.359067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.359067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.359067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.359067] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 is going to be created. [ 1030.380608] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.380846] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.381114] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.381450] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.381698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.381945] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.054881] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1031.055193] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea deletion is rescheduled due to dependency. [ 1031.055262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.132968] env[65973]: INFO networking_nsxv3.common.synchronization [req-913d19da-211e-4b97-98e7-654294b56ca5 req-9e7bdc66-06fb-4236-9cf8-bb24801a238b service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1031.133169] env[65973]: INFO networking_nsxv3.common.synchronization [req-913d19da-211e-4b97-98e7-654294b56ca5 req-9e7bdc66-06fb-4236-9cf8-bb24801a238b service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1031.133323] env[65973]: INFO networking_nsxv3.common.synchronization [req-913d19da-211e-4b97-98e7-654294b56ca5 req-9e7bdc66-06fb-4236-9cf8-bb24801a238b service nova] Enqueued Resource ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with Priority: HIGHEST for action port [ 1031.133837] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1031.134078] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1031.134078] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with Priority: HIGHEST for action port [ 1031.134352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.134498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.134647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.135017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.135101] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.136849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.136849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.136849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.136849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.136849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.136849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.136849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.137252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.140662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.140817] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.141746] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.141853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.141900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.142795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.142795] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f9d4a6-ecf6-468e-98b8-d9b4c64dea91',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.384829] env[65973]: INFO networking_nsxv3.common.synchronization [req-2100e356-3e6d-4cb3-a590-074cd0423f35 req-bc564671-fd63-4c4f-8d9e-42fc6c980f31 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 1031.384958] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGHEST for action security_group_members [ 1031.385688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.385688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.385688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.385884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.385884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.385988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.386056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.386226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.386314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.386433] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.643832] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.645961] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.645961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.645961] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with status ACTIVE [ 1031.646201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.646201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.646201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.646494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.648184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.648184] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.648184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.648184] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 is going to be updated. [ 1031.670211] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.670211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.670211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.670211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.670211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.670211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.770068] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1031.770175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.889112] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.889306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.889380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.889618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.889712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.889968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.890105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.890170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.890355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.890446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.890538] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa is going to be updated. [ 1031.918406] env[65973]: INFO networking_nsxv3.common.synchronization [req-556bdb76-d41e-494f-b8e7-3906aad2dfcd req-adf56e60-ac3e-45ba-905a-104acbca7169 tempest-ServerRescueTestJSON-683211413 tempest-ServerRescueTestJSON-683211413-project-member] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1031.919131] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1031.919772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.919772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.919926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.920156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.920375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.920529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.921054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.921681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.921936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.922103] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.923834] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.924102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.924272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.924458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.924780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.936324] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: IN_PROGRESS for 2s [ 1032.139241] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1032.139584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.139663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.140262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.140344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.140344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.140504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.140601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.140687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.140784] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.146949] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.321823] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.321823] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.321823] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.322068] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.322263] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.322394] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.322615] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.322726] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.322921] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.323167] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.323391] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.323558] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.323672] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.323792] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.323912] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.324058] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.352916] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.353193] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.353420] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.353505] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.353809] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-25ee7822-6e61-4698-9a21-9881697cf4db taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.353987] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.354201] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.354461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.354630] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ee7822-6e61-4698-9a21-9881697cf4db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.427901] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.642811] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.653032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.653032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.653219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.653332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.653641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.653641] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be created. [ 1032.684907] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.684907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.684907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.684907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.684907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.700671] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: UNINITIALIZED for 2s [ 1032.857535] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.857829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.858086] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.858546] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.858722] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.858928] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 25ee7822-6e61-4698-9a21-9881697cf4db not found, creating... [ 1032.859253] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.859497] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.859639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.859888] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.860051] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.860356] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.860526] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.860639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.860858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.861046] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.861207] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 25ee7822-6e61-4698-9a21-9881697cf4db is going to be created. [ 1032.883378] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.883588] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.883708] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.883979] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.884235] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.884454] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.930517] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.146224] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd44df49-8634-4dfe-bfa8-3fe62234533b: rpc.has_security_group_logging(os_id): False [ 1033.166914] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.167121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.167348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.167669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.167814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.168181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.168341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.168428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.168777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.168887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.168887] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be created. [ 1033.244517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.244517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.244517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.244517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.244517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.258862] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: IN_PROGRESS for 2s [ 1033.433454] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.433654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.433718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.434099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.434099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.434285] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be updated. [ 1033.466370] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.466587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.467057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.467173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.480290] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 1033.634468] env[65973]: INFO networking_nsxv3.common.synchronization [req-556bdb76-d41e-494f-b8e7-3906aad2dfcd req-5caf353f-b58d-41e8-b2bc-89c69f03fc8f service nova] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_rules [ 1033.634656] env[65973]: INFO networking_nsxv3.common.synchronization [req-556bdb76-d41e-494f-b8e7-3906aad2dfcd req-5caf353f-b58d-41e8-b2bc-89c69f03fc8f service nova] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1033.634930] env[65973]: INFO networking_nsxv3.common.synchronization [req-556bdb76-d41e-494f-b8e7-3906aad2dfcd req-5caf353f-b58d-41e8-b2bc-89c69f03fc8f service nova] Enqueued Resource ID: 25ee7822-6e61-4698-9a21-9881697cf4db with Priority: HIGHEST for action port [ 1033.635482] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_rules [ 1033.635625] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1033.635723] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ee7822-6e61-4698-9a21-9881697cf4db with Priority: HIGHEST for action port [ 1033.636181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.636181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.636347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.636437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.636516] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.637806] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.637905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.638140] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-25ee7822-6e61-4698-9a21-9881697cf4db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.638267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.638299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.638467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.638542] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ee7822-6e61-4698-9a21-9881697cf4db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.947721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa in Status: SUCCESS [ 1033.947908] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa deletion is rescheduled due to dependency. [ 1033.948037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.142137] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.142393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.142619] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25ee7822-6e61-4698-9a21-9881697cf4db with status ACTIVE [ 1034.142883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.143030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.143122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.143381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.143489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.143678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.143784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.143845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.144063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.144155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.144366] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.144461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.144563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.144713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.144806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.144890] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25ee7822-6e61-4698-9a21-9881697cf4db is going to be updated. [ 1034.167178] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.167471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.167471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.167629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.167766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.167951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25ee7822-6e61-4698-9a21-9881697cf4db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.712724] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1034.712944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.713200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.713510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.713719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.713845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.714397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.714649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.714946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.715102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.715352] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.219688] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.220113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.220113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.220228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.220464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.220558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.220558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.220747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.220836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.220961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.221216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.221334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.221376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.221553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.221702] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.221995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.221995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.222084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.222131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.222214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.222303] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.271427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1035.271642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.507429] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 1035.508187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.508731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.509071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.509430] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.509430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.509538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.509735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.509842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.510148] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.727434] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29: rpc.has_security_group_logging(os_id): False [ 1035.750189] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.750189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.750189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.750189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.750189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.750740] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.750740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.750740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.750740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.750882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.751378] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.751557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.751607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.751924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.752041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.752196] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.752299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.752363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.752513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.752592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.752680] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be created. [ 1035.827604] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.827604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.829102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.829102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.829102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.842497] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1035.881680] env[65973]: INFO networking_nsxv3.common.synchronization [req-5bbc7e49-39be-4ca1-9019-77d73ce406ce req-4665038b-8b45-49b2-8784-7c853d151171 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1035.882657] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1035.883604] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.884069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.884224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.884566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.884961] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.885252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.885373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.885691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.885840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.886045] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.013522] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.389234] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.389658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.389658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.389911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.390091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.390399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.390760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.392191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.392542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.392802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.393014] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1036.435695] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.436443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.436443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.436443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.436443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.453080] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1036.518301] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.022499] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.022780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.022903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.023474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.023624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.023789] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be updated. [ 1037.065920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.066122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.066239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.066464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.066620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.079142] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 1037.268042] env[65973]: INFO networking_nsxv3.common.synchronization [req-49be4274-d794-4de8-918f-711bf617d5df req-63416eaf-2e91-4d81-845c-a263006b2399 tempest-MigrationsAdminTest-845187131 tempest-MigrationsAdminTest-845187131-project-member] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 1037.268042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGHEST for action security_group_members [ 1037.268042] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.268042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.268042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.268286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.268286] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.268381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.268420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.268538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.268624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.269272] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.771154] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.771560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.771560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.771749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.771832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.772025] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.772142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.772198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.772372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.772441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.772532] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be updated. [ 1037.805044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.805188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.805282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.805535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.805751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.815826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: IN_PROGRESS for 2s [ 1037.855340] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1037.855637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.473525] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1038.474211] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 1038.474211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.089650] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 1039.089944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.089944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.090227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.090489] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.090641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.090730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.090939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.091179] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.091365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.091479] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.593908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.594259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.594259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.594401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.594573] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.595042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.595042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.595042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.595042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.595312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.595312] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.595429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.595429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.595537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.595694] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.595786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.595852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.596050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.596142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.596207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.596266] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.827141] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c in Status: SUCCESS [ 1039.827334] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c deletion is rescheduled due to dependency. [ 1039.827450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.101503] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcf87a61-c07f-4a06-b6bc-89ada25f6a9e: rpc.has_security_group_logging(os_id): False [ 1040.119203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.119349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.119410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.119646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.119729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.119927] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.120031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.120382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.120382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.120382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.120781] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.120781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.120781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.120953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.120953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.121407] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.121556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.121640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.121812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.121914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.122069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be updated. [ 1040.195388] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.195542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.195611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.195964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.196218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.216171] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 1040.931722] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.931916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.932085] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.932365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.932623] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.932781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.932893] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.933124] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.933278] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.933470] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.933579] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.933685] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.933788] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.933890] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.933989] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.934128] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.954280] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.954455] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.954756] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.954756] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.955098] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-8dd07a90-c3da-47d1-82a5-85367447eb5e taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.955270] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.955384] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.955648] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.955793] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd07a90-c3da-47d1-82a5-85367447eb5e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.460054] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.460054] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.460054] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.460826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.460826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.460826] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.460826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.461161] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.461161] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.461330] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.461473] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e is going to be updated. [ 1041.484460] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.484642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.484858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.485496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.485766] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.486198] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.204165] env[65973]: INFO networking_nsxv3.common.synchronization [req-e4d7c37c-8a89-40ba-b708-822cd9c69193 req-43f2e225-a1f5-426b-a9fd-9a803c217553 service nova] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 1042.205041] env[65973]: INFO networking_nsxv3.common.synchronization [req-e4d7c37c-8a89-40ba-b708-822cd9c69193 req-43f2e225-a1f5-426b-a9fd-9a803c217553 service nova] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 1042.205041] env[65973]: INFO networking_nsxv3.common.synchronization [req-e4d7c37c-8a89-40ba-b708-822cd9c69193 req-43f2e225-a1f5-426b-a9fd-9a803c217553 service nova] Enqueued Resource ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e with Priority: HIGHEST for action port [ 1042.205221] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_rules [ 1042.205391] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 1042.205622] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e with Priority: HIGHEST for action port [ 1042.205924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.206092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.206229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.207734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.208507] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.211519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.211519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.211519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.211519] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.211519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd07a90-c3da-47d1-82a5-85367447eb5e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.212384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.212384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.212384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.212384] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd07a90-c3da-47d1-82a5-85367447eb5e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.236368] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 1042.236491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.713865] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.714889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.714889] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.715892] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dd07a90-c3da-47d1-82a5-85367447eb5e with status ACTIVE [ 1042.715892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.716773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.716773] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.717085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.717085] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.717175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.717213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.717410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.717524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.717724] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dd07a90-c3da-47d1-82a5-85367447eb5e is going to be updated. [ 1042.740550] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.740746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.740863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.741145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.741285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.741560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd07a90-c3da-47d1-82a5-85367447eb5e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.221083] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.723390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.723804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.723804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.723891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.723929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.724038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be updated. [ 1043.753510] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.753773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.753773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.753947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.754060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.766665] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: IN_PROGRESS for 2s [ 1045.778218] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: SUCCESS [ 1045.778552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.778599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.778814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.779019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.779137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.779202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.779356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.779437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.779520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.779610] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.282143] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.784824] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8914f4ea-4ed1-4101-ab21-2b15a1da5534: rpc.has_security_group_logging(os_id): False [ 1046.807286] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.807448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.807516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.807826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.807886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.808241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.808460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.808460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.808653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.808653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.808831] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be updated. [ 1046.898638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.898638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.898638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.898988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.899289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.913328] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: IN_PROGRESS for 2s [ 1047.207454] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1047.207657] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1047.891040] env[65973]: INFO networking_nsxv3.common.synchronization [req-97715a39-21c7-40a4-8018-6ab8e81d3199 req-9821de4e-74ee-4cf9-a949-737df4108c2a tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1047.892426] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1047.892426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.892426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.892426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.892426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.892889] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.892889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.892889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.892889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.893040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.893074] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.249234] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.249234] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.249234] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.249234] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.249234] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.250147] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.250494] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.251161] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.251535] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.251974] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.252300] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.253925] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.253925] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.253925] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.253925] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.253925] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.276225] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.276225] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.276225] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.276468] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.276719] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-0b864c02-549a-4df8-97e1-647db5b85806 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.276885] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277040] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277811] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b864c02-549a-4df8-97e1-647db5b85806',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.396367] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.396692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.396692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.397052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.397191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.397528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.397674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.397746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.397959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.398133] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.398249] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1048.439663] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.439930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.440041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.440753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.441333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.459579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1048.698369] env[65973]: INFO networking_nsxv3.common.synchronization [None req-78143859-87b0-4b2a-a690-7bd3ca626b46 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1048.699076] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1048.699450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.699617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.699684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.699997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.704907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.782690] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.782935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.783082] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.785337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.785554] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.786754] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 0b864c02-549a-4df8-97e1-647db5b85806 not found, creating... [ 1048.786754] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.786754] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.786754] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.786754] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.787107] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.787177] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.787388] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.787537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.788882] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.788882] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.788882] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 0b864c02-549a-4df8-97e1-647db5b85806 is going to be created. [ 1048.813628] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.813628] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.813984] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.814063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.814266] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.814505] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.853318] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b623ef33-b338-4613-899b-e9297220e1c9 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1048.853318] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1048.853607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.853708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.931135] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: SUCCESS [ 1048.931626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.228405] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.228405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.228586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.228692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.228775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.228834] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 already deleted. [ 1049.228929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.229204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.229378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.229474] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.417289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.417289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.417675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.417675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.417751] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.573273] env[65973]: INFO networking_nsxv3.common.synchronization [req-97715a39-21c7-40a4-8018-6ab8e81d3199 req-e075a335-5e6f-4567-868a-02834a257247 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 1049.573484] env[65973]: INFO networking_nsxv3.common.synchronization [req-97715a39-21c7-40a4-8018-6ab8e81d3199 req-e075a335-5e6f-4567-868a-02834a257247 service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1049.573657] env[65973]: INFO networking_nsxv3.common.synchronization [req-97715a39-21c7-40a4-8018-6ab8e81d3199 req-e075a335-5e6f-4567-868a-02834a257247 service nova] Enqueued Resource ID: 0b864c02-549a-4df8-97e1-647db5b85806 with Priority: HIGHEST for action port [ 1049.574278] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 1049.574413] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1049.574512] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b864c02-549a-4df8-97e1-647db5b85806 with Priority: HIGHEST for action port [ 1049.574802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.574936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.574985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.575217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.575307] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.576194] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.576305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.576511] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b864c02-549a-4df8-97e1-647db5b85806 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.576670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.577498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.577659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.577716] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b864c02-549a-4df8-97e1-647db5b85806',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.755427] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.755427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.755427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.755427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.755427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.755427] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 already deleted. [ 1049.755427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.919674] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.079703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.080066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.080066] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b864c02-549a-4df8-97e1-647db5b85806 with status ACTIVE [ 1050.080377] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.080377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.080377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.080524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.080562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.080733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.080831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.080887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.081147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.081325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.081442] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.081623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.081623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.081820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.081866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.081974] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b864c02-549a-4df8-97e1-647db5b85806 is going to be updated. [ 1050.106667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.106867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.107221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.107380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.107483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.107750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.423184] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.470212] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1050.470581] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 1050.470744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.471357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.471628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.471838] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.471954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.472035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.472306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.472405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.472533] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.816098] env[65973]: INFO networking_nsxv3.common.synchronization [req-96649d4b-43f6-4c35-8f4b-923ddf4aef07 req-dfd1afff-c3c4-4776-8552-2e10bd0374d4 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1050.816883] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1050.819024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.819024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.819024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.819311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.819311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.819402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.820034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.820034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.820034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.820034] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.926662] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1050.926662] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1050.975030] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.277251] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.277624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.277624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.277834] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.278151] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.278397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.278528] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.278819] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.278999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.279305] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.279436] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.279572] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.279682] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.279803] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.279896] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.280038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.316881] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.317078] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.317124] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.317293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.317624] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.317841] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.317997] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.318354] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.318497] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2983ba5-86cd-4a2a-8f73-7331ed1a72db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.322009] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.479353] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.822025] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.822406] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.822406] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.822685] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.822841] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.822993] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port c2983ba5-86cd-4a2a-8f73-7331ed1a72db not found, creating... [ 1051.823271] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.823431] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.823554] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.823765] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.823891] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.824238] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.824400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.824536] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.824770] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.824988] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.825098] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: c2983ba5-86cd-4a2a-8f73-7331ed1a72db is going to be created. [ 1051.826494] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.848864] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.849717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.849717] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.850136] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.850548] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.851131] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.855082] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.855319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.855393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.855592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.870795] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1051.871793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.874722] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1051.948823] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.949110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.949110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.949318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.964207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.965110] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1051.965292] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'0b864c02-549a-4df8-97e1-647db5b85806'} {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1051.966058] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1051.982067] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.982240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.982300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.982524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.982605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.982708] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1052.045817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.045817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.045817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.046284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.046284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.061938] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1052.064049] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.064290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.064290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.064454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.066279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.066515] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1052.178677] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.178826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.179563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.179563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.179725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.179886] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1052.270811] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.270957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.271102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.272748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.272748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.272748] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1052.272748] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c83e6a14-269f-4653-a47c-a9fe58834679', '31ede63f-6bd9-48fa-8301-810c9ef645fa', 'c59c44f2-4848-4042-b55e-827765296b4c', '75299a7e-f943-422d-b243-adb623b647de', 'c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c', 'b0b456c0-ca3e-4dcf-883f-c2038bcc8151', '8f329967-b7d9-481b-b6ad-3fa408a45e60', 'de5c35fe-01e4-45c6-b69d-55e67887ab22', '47a89ecf-5ecf-49af-abb2-fb5522a607f0', '8da0d868-de85-4818-aa51-4d52389cba32', 'f771ba6a-073a-4849-9576-cace0561d5e9', 'ccf5934e-9748-40f8-8554-93454e399b70', 'b9b235ba-8426-4bfa-b2c5-84500087d8ea', '4a7bdbe9-2d27-4831-96b5-7ff1750a3241', '9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c', '85f4201e-cce4-4594-984e-4930f6cf0866', '8bf3c541-0add-4e54-89d3-ee7e90d5c0db', '1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1', '9ab1d1c8-44c8-4853-bf21-17ae4a372d5b', 'a575d40f-4efb-403b-a9bf-a1d03f827661', 'd1bdd946-26a6-42b9-91bc-053f074c2da1', '7fe395e3-e4a0-40a1-ae54-cd90d98c69f8', '88b4ac05-7dae-4c69-af3f-5a58ae902308', '30ffb193-a19e-4e24-a26f-e10ccbe9a34e', '364ddebc-6f46-4ac6-be33-ab246d291a56', '192ec921-b8c6-4174-b658-05183df07d9e', 'b5b10902-7db9-4679-995c-f5b279ca6ef4', '42226ea0-f68b-4929-8753-fb837ff84263', '3b841c0a-397f-4e9d-b02d-5feeaebf26a7', '1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de', '521f64c2-bdc1-44c3-9e8c-c4a684475213', 'f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2', 'fd44df49-8634-4dfe-bfa8-3fe62234533b', 'cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29', 'ab67debe-f546-499b-8301-c37179fecdee', '13b6ff97-cb4a-4c76-b07b-2e08a7615d07', 'b8ee6965-6080-4005-80bf-0264af4bd437', '79821cdf-baef-439f-bc9f-8fb2227beed1', 'dcf87a61-c07f-4a06-b6bc-89ada25f6a9e', '8914f4ea-4ed1-4101-ab21-2b15a1da5534', '9dcf9f05-2312-463f-a10f-331dffd06aeb', '2f7b78e3-6775-4a75-a625-09d47728d125', '9c8604cf-439a-4fd5-aaaf-d59a1eb46a27', '3639d272-10a3-4e14-b0d6-0d00cd61092b', '84af9696-6508-477b-a988-cda90bb86706', '7a7ed067-ae07-49f5-b03a-aa95774538ec', '12bf28a0-51ca-4171-b63e-ba9ad7a0139e', '78d1f177-ec77-4d3a-bc27-48a23b238428'} {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.272748] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1052.293749] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.293749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.294157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.294157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.294234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.294747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1052.294747] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.294747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1052.332815] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.332815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.332815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.332815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.332815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.332815] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1052.367186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.367186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.367186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.367186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.367466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.382638] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1052.405087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.405087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.405087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.405087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.405565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.406063] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1052.406212] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.406350] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1052.406467] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1052.406600] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b864c02-549a-4df8-97e1-647db5b85806 with Priority: HIGH for action port [ 1052.406710] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/48 resources of Type:Security Group Rules [ 1052.407208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 1052.407208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGH for action security_group_rules [ 1052.407208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGH for action security_group_rules [ 1052.407208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 1052.407694] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGH for action security_group_rules [ 1052.408145] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGH for action security_group_rules [ 1052.408553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGH for action security_group_rules [ 1052.408553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGH for action security_group_rules [ 1052.408553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.669833] env[65973]: INFO networking_nsxv3.common.synchronization [req-96649d4b-43f6-4c35-8f4b-923ddf4aef07 req-846c61ba-8f66-4346-8f5e-f61e4873248b service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1052.670207] env[65973]: INFO networking_nsxv3.common.synchronization [req-96649d4b-43f6-4c35-8f4b-923ddf4aef07 req-846c61ba-8f66-4346-8f5e-f61e4873248b service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1052.670584] env[65973]: INFO networking_nsxv3.common.synchronization [req-96649d4b-43f6-4c35-8f4b-923ddf4aef07 req-846c61ba-8f66-4346-8f5e-f61e4873248b service nova] Enqueued Resource ID: c2983ba5-86cd-4a2a-8f73-7331ed1a72db with Priority: HIGHEST for action port [ 1052.671415] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1052.671752] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1052.672165] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2983ba5-86cd-4a2a-8f73-7331ed1a72db with Priority: HIGHEST for action port [ 1052.672417] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b864c02-549a-4df8-97e1-647db5b85806 with Priority: HIGH for action port [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f4201e-cce4-4594-984e-4930f6cf0866 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf5934e-9748-40f8-8554-93454e399b70 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 with Priority: HIGH for action security_group_rules [ 1052.674044] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGH for action security_group_rules [ 1052.674817] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 1052.674817] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGH for action security_group_rules [ 1052.674817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.674817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.674817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.675069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.675069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.675919] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.676024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.676237] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.676349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.676402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.678082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.678082] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2983ba5-86cd-4a2a-8f73-7331ed1a72db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.679561] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b864c02-549a-4df8-97e1-647db5b85806 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.679691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.679741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.679904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.679976] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b864c02-549a-4df8-97e1-647db5b85806',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.684386] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31ede63f-6bd9-48fa-8301-810c9ef645fa taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.684386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.684599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.684791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.684791] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31ede63f-6bd9-48fa-8301-810c9ef645fa',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.686228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.686228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.686228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.686228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.686228] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.686973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.687098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.687161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.687405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.687468] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a7bdbe9-2d27-4831-96b5-7ff1750a3241',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.688402] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.688704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.688704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.688793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.689834] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ab1d1c8-44c8-4853-bf21-17ae4a372d5b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.689834] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.690086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.690086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.690165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.690247] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.690916] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.691038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.691144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.691393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.691393] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf3c541-0add-4e54-89d3-ee7e90d5c0db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.692260] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f4201e-cce4-4594-984e-4930f6cf0866 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.692579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.692676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.692833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.692919] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f4201e-cce4-4594-984e-4930f6cf0866',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.694059] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.694177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.694244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.694953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.694953] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.695138] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.695240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.695364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.695513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.695662] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.696345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf5934e-9748-40f8-8554-93454e399b70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.696462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.696504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.696654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.696720] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf5934e-9748-40f8-8554-93454e399b70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.697578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.697692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.697735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.697898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.698097] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.698678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.698759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.698853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.699425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.699425] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.699778] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.699891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.699936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.700094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.700158] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a89ecf-5ecf-49af-abb2-fb5522a607f0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.700931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.701090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.701154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.701326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.701400] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.702222] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.702349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.702454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.702659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.702717] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.703490] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f329967-b7d9-481b-b6ad-3fa408a45e60 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.703659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.703706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.704143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.704143] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f329967-b7d9-481b-b6ad-3fa408a45e60',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.705272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.705272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.705272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.705272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.705272] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.706167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.706298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.706550] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.706682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.706791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.707044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.707266] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.173089] env[65973]: INFO networking_nsxv3.common.synchronization [req-348a1fb4-f501-4915-91ee-5437749a8500 req-33a2d835-63d0-43a1-93a7-7794c275e7a3 tempest-ServersNegativeTestJSON-1329693835 tempest-ServersNegativeTestJSON-1329693835-project-member] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1053.174174] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1053.174755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.175043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.175227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.175568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.175871] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.176402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.176810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.177253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.177598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.177721] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.179596] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2983ba5-86cd-4a2a-8f73-7331ed1a72db with status ACTIVE [ 1053.179905] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.180455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.180602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.181710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.181710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.181710] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.182034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.182034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.182336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.182509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.182843] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.183051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.183463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.183463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.183612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.183781] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2983ba5-86cd-4a2a-8f73-7331ed1a72db is going to be updated. [ 1053.209829] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.210052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.210052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.210273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.210414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.210785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2983ba5-86cd-4a2a-8f73-7331ed1a72db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.215339] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.220324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.220429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.220691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.220903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.221102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.221102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.221275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.221350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.221458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.221572] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.225302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.225302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.225302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.225907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.225907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.226470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.227018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.227018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.227018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.227018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.228167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.228167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.228167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.228167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.228167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.228167] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.231601] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b864c02-549a-4df8-97e1-647db5b85806 with status ACTIVE [ 1053.231835] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.231971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.232458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.232710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.232818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.233046] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.233159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.233216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.233376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.233446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.233654] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.233789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.233885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.234043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.234124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.234216] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b864c02-549a-4df8-97e1-647db5b85806 is going to be updated. [ 1053.236592] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.237261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.237261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.238230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.238514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.239634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.239731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.239974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.240077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.240264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.240360] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.242018] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.242018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.256246] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.256460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.256596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.256798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.256980] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.257119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.257612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.257825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.257945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.258076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.258179] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.336951] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.336951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.336951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.337636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.342060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.342568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.344515] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.344515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.351269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.351798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.353883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.354079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.355054] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.355163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.356131] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.356329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.357261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.357380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.358798] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.358798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.359551] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.359648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.360497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.360638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.361776] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.362398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.362560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.365094] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.365726] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.365885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.375976] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.376864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.376864] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31ede63f-6bd9-48fa-8301-810c9ef645fa is going to be deleted. [ 1053.380488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.380488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.381502] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.381725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.381725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.382622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.382622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.382622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b864c02-549a-4df8-97e1-647db5b85806" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.405086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.405244] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be deleted. [ 1053.406760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.407187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.439917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.440102] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a7bdbe9-2d27-4831-96b5-7ff1750a3241 is going to be deleted. [ 1053.441281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.441568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.500198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.500346] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f4201e-cce4-4594-984e-4930f6cf0866 is going to be deleted. [ 1053.501405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.501676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.527395] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.527547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.557836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.558047] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c is going to be deleted. [ 1053.559208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.559531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.562581] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.562756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.574809] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.574809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.588642] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.588804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.608638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.608916] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ab1d1c8-44c8-4853-bf21-17ae4a372d5b is going to be deleted. [ 1053.610318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.610601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.646497] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.646736] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.646858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.647167] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.647532] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.647718] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.647878] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.648347] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.648513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.648798] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.648920] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.649038] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.649145] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.649251] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.649457] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.649507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.662615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.662747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf3c541-0add-4e54-89d3-ee7e90d5c0db is going to be deleted. [ 1053.663828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.664068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.679947] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.680219] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.686159] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.690168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.690346] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.690522] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.690662] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.690995] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-1a4a8695-7349-4ffb-a265-0c7a88966377 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.691230] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.691354] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.691807] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.691904] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4a8695-7349-4ffb-a265-0c7a88966377',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.744802] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.745914] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.747607] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.748817] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.767225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.767354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f329967-b7d9-481b-b6ad-3fa408a45e60 is going to be deleted. [ 1053.768502] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.770565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.770565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.785959] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.786190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.787329] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.787498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.820769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.820938] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf5934e-9748-40f8-8554-93454e399b70 is going to be deleted. [ 1053.822181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.822403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.881535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.881681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c is going to be deleted. [ 1053.882825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.884709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.922176] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.922373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.928407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.928604] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a89ecf-5ecf-49af-abb2-fb5522a607f0 is going to be deleted. [ 1053.929628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.929885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.956864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.957091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.986965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.987154] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be deleted. [ 1053.988203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.988465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.052182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.053327] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1 is going to be deleted. [ 1054.054570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.057667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.057667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.058060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31ede63f-6bd9-48fa-8301-810c9ef645fa" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.058200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.058476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.058703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.058963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.060990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.061307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.061896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.062224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a7bdbe9-2d27-4831-96b5-7ff1750a3241" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.067475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.067825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.068020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.068439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f4201e-cce4-4594-984e-4930f6cf0866" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.068439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.068707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.068812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.068986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba4924d-6e9e-4008-8ca9-86e9d2e9d55c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.069668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.069894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.070027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.070204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf3c541-0add-4e54-89d3-ee7e90d5c0db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.070409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.070604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.070743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.070900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ab1d1c8-44c8-4853-bf21-17ae4a372d5b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.071144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.071396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.071537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.071709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f329967-b7d9-481b-b6ad-3fa408a45e60" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.071886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.072099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.072227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.072367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf5934e-9748-40f8-8554-93454e399b70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.076728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.076963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.076963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.077176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.077295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.077393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a89ecf-5ecf-49af-abb2-fb5522a607f0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.091511] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1054.091813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.092036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.092256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.092458] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.092585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.092663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.092842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.092932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.093050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.093130] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.152403] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.152403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.152403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.152403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.152403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.152403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c7644c-86a9-4b5d-9c2b-9cb7fb3b523c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.167270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.167270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.167270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.167270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.167270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.167270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.185034] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1054.186713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.186713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.186713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.186713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.186713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.186713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb281b5-43b6-4f90-bd2a-df4ccf32ddb1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.188812] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.195676] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.195842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.195842] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.196796] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.196796] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.196796] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 1a4a8695-7349-4ffb-a265-0c7a88966377 not found, creating... [ 1054.196978] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.197084] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.197253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.197566] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.197753] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.198507] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.198507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.198507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.198764] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.198905] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.199019] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 1a4a8695-7349-4ffb-a265-0c7a88966377 is going to be created. [ 1054.240424] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.240424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.240424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.240424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.240424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.240424] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.247666] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b456c0-ca3e-4dcf-883f-c2038bcc8151: rpc.has_security_group_logging(os_id): False [ 1054.249644] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de5c35fe-01e4-45c6-b69d-55e67887ab22: rpc.has_security_group_logging(os_id): False [ 1054.252747] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8da0d868-de85-4818-aa51-4d52389cba32: rpc.has_security_group_logging(os_id): False [ 1054.253831] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f771ba6a-073a-4849-9576-cace0561d5e9: rpc.has_security_group_logging(os_id): False [ 1054.272814] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c59c44f2-4848-4042-b55e-827765296b4c: rpc.has_security_group_logging(os_id): False [ 1054.308941] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.309158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.309158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.309385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.311858] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.312056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.319874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.320097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.327785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.328047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.342510] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.342901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.365102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.365291] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.365291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.365439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.365803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.366025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.366238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 is going to be updated. [ 1054.369014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.369649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.402563] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1054.403172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.403172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.403172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.403477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.403583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.403583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.404020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.404159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.404270] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.439249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.439614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.439771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.439852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.440159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.440263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.440367] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1054.441799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.441996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.481837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.482236] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.482363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.482407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.482643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.482736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.482871] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 is going to be updated. [ 1054.484746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.485015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.497374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.497374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.513832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.514178] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.514316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.514384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.514550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.514646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.514725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 is going to be updated. [ 1054.516084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.516282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.545029] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.545195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.579245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.579587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.579882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.579882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.580076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.580169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.580266] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59c44f2-4848-4042-b55e-827765296b4c is going to be updated. [ 1054.581586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.581798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.581943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.582983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.583163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.583305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.585298] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.585428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.585496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.585887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.586050] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.589107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.589309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.589385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.589576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.589710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.596398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.596606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.596651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.596861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597775] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.598065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.598219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.598403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.598403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.598649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.598649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.598770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.598770] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.639477] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: IN_PROGRESS for 2s [ 1054.640749] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1054.641223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: IN_PROGRESS for 2s [ 1054.646586] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: IN_PROGRESS for 2s [ 1054.692638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.692638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.692638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.692638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.692638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.692638] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1054.750121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.750121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.750121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.750121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.750121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.768524] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.768731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.768731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.769114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.769320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.773919] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: IN_PROGRESS for 2s [ 1054.783151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1054.907309] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.953291] env[65973]: INFO networking_nsxv3.common.synchronization [req-348a1fb4-f501-4915-91ee-5437749a8500 req-d1bf3c7e-9594-4be4-8fdd-060275c15aaa service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1054.953370] env[65973]: INFO networking_nsxv3.common.synchronization [req-348a1fb4-f501-4915-91ee-5437749a8500 req-d1bf3c7e-9594-4be4-8fdd-060275c15aaa service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1054.953506] env[65973]: INFO networking_nsxv3.common.synchronization [req-348a1fb4-f501-4915-91ee-5437749a8500 req-d1bf3c7e-9594-4be4-8fdd-060275c15aaa service nova] Enqueued Resource ID: 1a4a8695-7349-4ffb-a265-0c7a88966377 with Priority: HIGHEST for action port [ 1054.954463] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1054.954665] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1054.954807] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a4a8695-7349-4ffb-a265-0c7a88966377 with Priority: HIGHEST for action port [ 1054.957086] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.957263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.957322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.957499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.957577] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.958768] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.958879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.959446] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a4a8695-7349-4ffb-a265-0c7a88966377 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.959624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.959727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.960033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.960161] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4a8695-7349-4ffb-a265-0c7a88966377',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.100970] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 1055.124801] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.124801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.124801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.125237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.150472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.150748] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.150964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.151144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.151412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.151539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.151780] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.151961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.152094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.152242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.152325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.152514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.152608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.152668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.152814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.152893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.153045] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1055.246304] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.246529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.246628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.246875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.247073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.265377] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1055.413891] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.463803] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.464066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.464314] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a4a8695-7349-4ffb-a265-0c7a88966377 with status ACTIVE [ 1055.464564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.464702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.464782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.465083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.465211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.465445] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.465578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.465664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.465937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.466091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.466250] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.466442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.466491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.466649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.466752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.466867] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a4a8695-7349-4ffb-a265-0c7a88966377 is going to be updated. [ 1055.490641] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.490825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.490918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.491264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.491427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.491671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a4a8695-7349-4ffb-a265-0c7a88966377" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.916735] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.917063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.917155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.917429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.917864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.917864] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1055.944706] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 412 Client Error: Precondition Failed for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/groups/2f7b78e3-6775-4a75-a625-09d47728d125 [ 1055.944905] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1056.081775] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.082019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.082019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.084206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.084206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.084584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.084700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.084758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.084943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.085035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.085150] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1056.120186] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.120344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.120413] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.120640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.120903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.136059] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1056.235727] env[65973]: INFO networking_nsxv3.common.synchronization [req-ef853d6a-0b6a-4531-876d-8cc2f8c2e835 req-f65c73bd-3a1d-4d88-b0e6-e3d2f120af2b tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1056.236183] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1056.236883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.236883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.237098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.237204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.237371] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.237461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.237588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.237947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.237947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.237947] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.664478] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1056.665375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.666103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: SUCCESS [ 1056.666390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.667399] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: SUCCESS [ 1056.667636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.668839] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: SUCCESS [ 1056.669338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.710231] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.710624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.710624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.710867] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.711176] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.711357] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.711466] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.711684] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.711831] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.712054] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.712154] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.712259] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.712362] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.712466] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.712570] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.712700] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.739782] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.740081] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.740193] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.740409] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.740825] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-f0623592-9c43-419a-a3e5-c26b37df3f01 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.741100] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.741257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.742200] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.742200] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0623592-9c43-419a-a3e5-c26b37df3f01',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.742970] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.743132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.743250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.743472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.743563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.743863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.743989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.744061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.744203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.744277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.744358] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 already deleted. [ 1056.744448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.791637] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: SUCCESS [ 1056.791868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.793054] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1056.793241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.793395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.793637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.793828] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.793942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.794010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.794294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.794380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.794478] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.245783] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.246015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.246165] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.246400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.246535] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.246689] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port f0623592-9c43-419a-a3e5-c26b37df3f01 not found, creating... [ 1057.246945] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.247115] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.247226] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.247606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.247662] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.248119] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.248312] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.248858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.249140] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.249342] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.249517] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: f0623592-9c43-419a-a3e5-c26b37df3f01 is going to be created. [ 1057.277568] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.278507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.278507] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.278765] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.279284] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.279642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.281355] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1057.281652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.281970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.282283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.282414] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.296847] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.785498] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.785953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.785953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.785953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.786147] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.786248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.786298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.786512] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.786593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.786684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.786772] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.800596] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.015096] env[65973]: INFO networking_nsxv3.common.synchronization [req-ef853d6a-0b6a-4531-876d-8cc2f8c2e835 req-fb9a743b-2c89-4634-a85e-f5c137f55de4 service nova] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1058.017493] env[65973]: INFO networking_nsxv3.common.synchronization [req-ef853d6a-0b6a-4531-876d-8cc2f8c2e835 req-fb9a743b-2c89-4634-a85e-f5c137f55de4 service nova] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1058.017493] env[65973]: INFO networking_nsxv3.common.synchronization [req-ef853d6a-0b6a-4531-876d-8cc2f8c2e835 req-fb9a743b-2c89-4634-a85e-f5c137f55de4 service nova] Enqueued Resource ID: f0623592-9c43-419a-a3e5-c26b37df3f01 with Priority: HIGHEST for action port [ 1058.017493] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_rules [ 1058.017493] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1058.017493] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0623592-9c43-419a-a3e5-c26b37df3f01 with Priority: HIGHEST for action port [ 1058.017493] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.017493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.017493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.017493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.017493] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.018544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.018544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.018544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.018720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.019816] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.019816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.019816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.020038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.020074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.020203] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.021428] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0623592-9c43-419a-a3e5-c26b37df3f01 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.021428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.021663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.021663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.021835] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0623592-9c43-419a-a3e5-c26b37df3f01',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.150742] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.150742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.150742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.150742] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.292030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.292030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.292030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.292804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.292804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.292804] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.303458] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.304241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.304241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.304241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.304241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.304241] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1058.367132] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.368438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.368438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.368438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.368438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.383602] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1058.524616] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.524936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.525221] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.526520] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0623592-9c43-419a-a3e5-c26b37df3f01 with status ACTIVE [ 1058.526809] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.526887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.526980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.527352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.527519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.527817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.528069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.528138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.528348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.528536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.528787] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.528922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.529099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.529329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.529451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.529557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0623592-9c43-419a-a3e5-c26b37df3f01 is going to be updated. [ 1058.557032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.557032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.557032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.557032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.557032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.557032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0623592-9c43-419a-a3e5-c26b37df3f01" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.652766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.652986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.652986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.653281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.653462] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.653462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.653563] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.653682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.653774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.653865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.654021] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.654146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.654373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.654373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.654488] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.654580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.654656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.654798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.654864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.654950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.655056] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.797018] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 1058.813516] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.813737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.813782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.814068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.814188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.814426] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.814521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.814584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.814743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.814814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.814979] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.815096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.815156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.815295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.815363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.815572] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.815663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.815720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.815857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.815941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.816685] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1058.889159] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.889888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.889888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.889888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.890195] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.923050] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1059.031678] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.157579] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 1059.183038] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.183038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.183038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.183038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.208723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.209075] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.209236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.209306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.209517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.209597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.209802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.209900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.209963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.210176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.210224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.210410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.211296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.211296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.211296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.211296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.211296] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1059.275849] env[65973]: INFO networking_nsxv3.common.synchronization [req-e3cca0aa-54cc-4931-8b98-af98c78c10d9 req-b9db1ebf-4977-4954-a109-8306b6d3d6a1 tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1059.278263] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1059.278263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.278263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.278263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.278263] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.280385] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.281893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.281893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.281893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.281893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.298344] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1059.538660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.538660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.538660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.538660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.538660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.538660] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 is going to be created. [ 1059.564023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.564023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.564023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.564023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.564023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.574042] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: UNINITIALIZED for 2s [ 1059.676474] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.676474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.676474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.676474] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.676663] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.676946] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.677161] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.677407] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.677579] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.677809] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.677948] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.678092] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.678285] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.678431] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.678522] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.678685] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.703255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.703432] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.703568] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.703735] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-478" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.704098] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.704274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.704390] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.704726] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.704864] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14ec885-ff08-4b2b-ac9a-b2ad551d5924',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.782918] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.783091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.783154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.783473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.810364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.810364] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.810364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.810364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.810364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.810364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.810364] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1059.838597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.838755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.838881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.839175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.839289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.853613] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1060.014809] env[65973]: INFO networking_nsxv3.common.synchronization [req-3f84daff-31fc-4399-91db-676f11369930 req-fb1908ed-ff49-44ca-a962-5455c3e586ef tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1060.015444] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGHEST for action security_group_members [ 1060.015839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.016018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.016117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.016388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.016563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.016790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.016856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.017055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.017335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.017423] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.212747] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.213028] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.213197] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.213482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.213633] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.213788] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port a14ec885-ff08-4b2b-ac9a-b2ad551d5924 not found, creating... [ 1060.214061] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.214227] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.214385] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.214640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.214839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.215163] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.215333] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.215458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.215660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.215790] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.215927] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: a14ec885-ff08-4b2b-ac9a-b2ad551d5924 is going to be created. [ 1060.240609] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.240609] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.240609] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.240824] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.241065] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.241519] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.400177] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1060.400544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.400766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.401067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.401373] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.401515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.401584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.401836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.401956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.402138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.402296] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.519543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.519754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.519848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.520180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.520270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.520517] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.520686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.520777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.521030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.521176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.521285] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 is going to be updated. [ 1060.555384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.555384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.555612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.555645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.556535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.565808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: IN_PROGRESS for 2s [ 1060.905011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.905266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.905266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909287] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909287] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.938805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1060.939040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.967428] env[65973]: INFO networking_nsxv3.common.synchronization [req-e3cca0aa-54cc-4931-8b98-af98c78c10d9 req-9a339355-5c2f-4cba-9742-b324a80bb2bd service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 1060.967608] env[65973]: INFO networking_nsxv3.common.synchronization [req-e3cca0aa-54cc-4931-8b98-af98c78c10d9 req-9a339355-5c2f-4cba-9742-b324a80bb2bd service nova] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1060.967736] env[65973]: INFO networking_nsxv3.common.synchronization [req-e3cca0aa-54cc-4931-8b98-af98c78c10d9 req-9a339355-5c2f-4cba-9742-b324a80bb2bd service nova] Enqueued Resource ID: a14ec885-ff08-4b2b-ac9a-b2ad551d5924 with Priority: HIGHEST for action port [ 1060.968249] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_rules [ 1060.968392] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1060.968493] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14ec885-ff08-4b2b-ac9a-b2ad551d5924 with Priority: HIGHEST for action port [ 1060.968796] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.968871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.968935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.969194] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.969278] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.970135] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.970252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.970431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.970993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.970993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.970993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.970993] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14ec885-ff08-4b2b-ac9a-b2ad551d5924',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.322617] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1061.322617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.410125] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29: rpc.has_security_group_logging(os_id): False [ 1061.440391] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.440591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.440634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.441016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.463487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.463978] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.464216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.464369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.464614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.464765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.465139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.465304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.465488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.465762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.465871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.466189] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.466366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.466464] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.466687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.466794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.466977] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1061.473254] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.473527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.473710] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a14ec885-ff08-4b2b-ac9a-b2ad551d5924 with status ACTIVE [ 1061.473763] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.473837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.473919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.474338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.474516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.474775] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.474877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.474987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.476043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.476043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.476043] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.476043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.476043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.476358] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.476386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.476498] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a14ec885-ff08-4b2b-ac9a-b2ad551d5924 is going to be updated. [ 1061.515557] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.515726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.515807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.516431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.516431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.516431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a14ec885-ff08-4b2b-ac9a-b2ad551d5924" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.559060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.559060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.559060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.559278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.559303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.583822] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1061.594304] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: SUCCESS [ 1061.594561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.594760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.595052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.595293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.595452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.595521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.595727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.595831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.595925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.596047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.875940] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1061.875940] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 1061.875940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.876526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.876781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.876977] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.877141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.877227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.877397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.877474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.877569] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.099055] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.380877] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.579663] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 in Status: SUCCESS [ 1062.579948] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 deletion is rescheduled due to dependency. [ 1062.580136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.600754] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 489f909b-5c83-4f6d-9b65-b33d0f523a47: rpc.has_security_group_logging(os_id): False [ 1062.629860] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.630074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.630146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.630344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.630475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.630736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.630846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.630941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.631188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.631279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.631378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 is going to be created. [ 1062.699666] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.699666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.699666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.699666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.699666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.713675] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: IN_PROGRESS for 2s [ 1062.883180] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.012906] env[65973]: INFO networking_nsxv3.common.synchronization [req-f9f7f1cf-f314-4812-b125-accc4d382e4d req-454a9a4a-9c07-4077-98b0-9d5b59dfaa1a tempest-ServerRescueTestJSON-683211413 tempest-ServerRescueTestJSON-683211413-project-member] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1063.012906] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1063.012906] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.013239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.013239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.013349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.014227] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.014227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.014227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.014227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.014227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.014227] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.385392] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.385693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.385693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.385848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.385965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.386085] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1063.422429] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.422429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.422429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.422429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.422429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.438352] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1063.515896] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.601974] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1063.602400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.019545] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.521479] env[65973]: INFO networking_nsxv3.common.synchronization [req-d84a8930-2228-4a01-b7af-ecc0a0f1fe85 req-00a0c693-4861-446d-963d-4caf6dbb8cdb tempest-ServersTestBootFromVolume-26785003 tempest-ServersTestBootFromVolume-26785003-project-member] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1064.522240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.522240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.522240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.522363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.522363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.522491] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be updated. [ 1064.524152] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGHEST for action security_group_members [ 1064.524419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.524548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.524548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.525579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.525579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.525579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.525579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.525579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.525579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.525579] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.561285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.561661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.561780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.562095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.562310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.575055] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 1064.731973] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: SUCCESS [ 1064.732355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.027161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.027423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.027534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.027783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.052305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.052749] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.053261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.053261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.053419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.053419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.053581] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 is going to be updated. [ 1065.080422] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.080663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.080736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.080943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.081172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.092566] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: IN_PROGRESS for 2s [ 1065.449515] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1065.449732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.450033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.450144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.450356] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.450533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.450582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.450740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.450819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.450939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.451047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.529326] env[65973]: INFO networking_nsxv3.common.synchronization [req-e6c1bea1-ee20-4fdf-9f95-060d1258f6b5 req-353b39ca-d0a6-4627-8aa1-2071b7a18999 tempest-ServersNegativeTestJSON-1329693835 tempest-ServersNegativeTestJSON-1329693835-project-member] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1065.529326] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1065.529620] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.529620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.529620] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.529786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.529944] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.530061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.530125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.530276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.530361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.530457] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.953621] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.953867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.953961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.954373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.954618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.954753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.954839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.955048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.955217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.955327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.955563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.955756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.955866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.956063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.956219] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.956390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.956390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.956533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.956611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.956697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.956881] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.032500] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.459637] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8: rpc.has_security_group_logging(os_id): False [ 1066.493675] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.493768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.493942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.494191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.494669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.494669] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.494821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.494865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.495122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.495242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.495570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.495770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.495842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.496034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.496142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.496453] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.496604] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.496704] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.496920] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.497060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.497217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1066.534765] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.596448] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 1066.596700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.608117] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.608117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.608117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.608117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.608117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.626748] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1067.037569] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.037755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.037803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.038500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.038500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.038616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1067.072699] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.072841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.072913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.073166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.073321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.082505] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1067.119725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 in Status: SUCCESS [ 1067.119907] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 deletion is rescheduled due to dependency. [ 1067.120030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.647578] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1068.648035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.093992] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1069.094226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.530536] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1070.530536] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1071.687644] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb5b09bf-7cbd-44a8-abcb-20eef3427002 req-41ada507-ee4e-4d15-8c03-e81338d304fa tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1071.688642] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1071.689235] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.689678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.689678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.689801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.689865] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.689962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.690643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.690643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.690643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.690643] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.023563] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.023795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.024098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.024195] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.024451] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.024606] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.024719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.024924] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.025250] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.025485] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.025596] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.025703] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.025806] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.025915] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.026016] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.026159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.051029] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.051029] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.051029] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.051029] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.051295] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.051601] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.051601] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.051930] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.052118] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.160197] env[65973]: INFO networking_nsxv3.common.synchronization [req-ffd8dc72-2ab5-49ff-a124-241b385075ac req-5b5c2c4b-d9a7-4eaa-8e9d-0cefa42e16f6 tempest-ServerRescueTestJSON-683211413 tempest-ServerRescueTestJSON-683211413-project-member] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1072.160576] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGHEST for action security_group_members [ 1072.160884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.161018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.161104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.161746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.162109] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.162273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.162386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.162584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.162675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.162777] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.192633] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.555142] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.555337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.555419] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.555837] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.556057] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.556273] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 not found, creating... [ 1072.556615] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.556776] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.556891] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.557127] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.557262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.557543] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.557695] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.557806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.558023] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.558156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.558290] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 is going to be created. [ 1072.579135] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.579371] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.579495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.579813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.580134] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.580372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.664931] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.665141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.665184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.665449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.688763] env[65973]: INFO networking_nsxv3.common.synchronization [req-1bdd1962-47de-478e-8a63-2b880f1b8e41 req-d58896e6-a84e-4bde-afa5-52561393fd1d tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 1072.689387] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGHEST for action security_group_members [ 1072.689720] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.689843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.689935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.690163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.690322] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.690423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.690478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.690625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.690714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.690805] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.694842] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.700935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.701275] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.701402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.701471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.701674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.701760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.701849] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be updated. [ 1072.739576] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.739752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.739752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.739924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.740078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.749805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: IN_PROGRESS for 2s [ 1073.193753] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.193753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.193753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.193978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.196598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.196893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.196893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.197025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.197140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.197140] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1073.216955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.217290] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.217412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.217446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.217786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.217786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.217868] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 is going to be updated. [ 1073.230645] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.230832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.230832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.231091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.231330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.240421] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1073.249375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.249610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.249767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.250035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.250148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.265335] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: IN_PROGRESS for 2s [ 1073.294130] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb5b09bf-7cbd-44a8-abcb-20eef3427002 req-5aa034c5-60ba-49db-afef-9e8ebfda0903 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1073.294326] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb5b09bf-7cbd-44a8-abcb-20eef3427002 req-5aa034c5-60ba-49db-afef-9e8ebfda0903 service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1073.294326] env[65973]: INFO networking_nsxv3.common.synchronization [req-eb5b09bf-7cbd-44a8-abcb-20eef3427002 req-5aa034c5-60ba-49db-afef-9e8ebfda0903 service nova] Enqueued Resource ID: a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 with Priority: HIGHEST for action port [ 1073.294865] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1073.294999] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1073.295108] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 with Priority: HIGHEST for action port [ 1073.295381] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.295560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.295606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.295772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.295849] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.296741] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.296877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.297155] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.297155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.297256] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.297388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.297484] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.799955] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.800308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.800308] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 with status ACTIVE [ 1073.800448] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.800554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.800618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.800846] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.800934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.801126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.801278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.801337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.801491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.801585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.801785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.801891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.801982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.802222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.802310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.802396] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21 is going to be updated. [ 1073.828386] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.828584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.828584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.828790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.828932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.829237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3e7aecd-fbc9-4364-99a7-80b1ac6e1d21" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.769804] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e in Status: SUCCESS [ 1074.770070] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e deletion is rescheduled due to dependency. [ 1074.770196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.251113] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1075.251425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.251638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.251899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.252167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.252307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.252394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.252597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.252692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.252818] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.278140] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 in Status: SUCCESS [ 1075.278140] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 deletion is rescheduled due to dependency. [ 1075.278559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.755771] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.259532] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.763944] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.763944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.763944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.764291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.764291] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.764420] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1076.797601] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.797897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.797966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.798220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.798383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.810103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1076.914352] env[65973]: INFO networking_nsxv3.common.synchronization [req-9444ff02-2d42-4aff-8042-c72671abed8f req-0c921adb-0d28-4466-9cec-a1a96a2911f2 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1076.915602] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1076.916056] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.916141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.916175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.917779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.918079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.918215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.918346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.918467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.918594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.918655] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.943130] env[65973]: INFO networking_nsxv3.common.synchronization [req-9444ff02-2d42-4aff-8042-c72671abed8f req-0c921adb-0d28-4466-9cec-a1a96a2911f2 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1076.943130] env[65973]: INFO networking_nsxv3.common.synchronization [req-9444ff02-2d42-4aff-8042-c72671abed8f req-0c921adb-0d28-4466-9cec-a1a96a2911f2 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1076.943130] env[65973]: INFO networking_nsxv3.common.synchronization [req-9444ff02-2d42-4aff-8042-c72671abed8f req-0c921adb-0d28-4466-9cec-a1a96a2911f2 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1076.943130] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1076.943130] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1076.944092] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1076.944519] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.945469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.945769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.946771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.946941] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.948902] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.949127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.949551] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.949778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.950059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.950320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.950482] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c89e77-71c1-44e2-baa0-2c6d76b4fa8d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.421825] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.449314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.449471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.452607] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with status ACTIVE [ 1077.452855] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.452990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.453072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.453287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.453376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.453601] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.454160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.454160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.454160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.454160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.454160] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.454350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.454350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.454461] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.454538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.454666] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d is going to be updated. [ 1077.476216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.476416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.476416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.476623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.476753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.476902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.568673] env[65973]: INFO networking_nsxv3.common.synchronization [req-5eae25db-d054-4a76-806d-7e7d4165c81b req-bfc7c8d5-e27a-41ca-beb5-e413f6a79070 tempest-AttachVolumeTestJSON-199672847 tempest-AttachVolumeTestJSON-199672847-project-member] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 1077.569681] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGHEST for action security_group_members [ 1077.569979] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.570116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.570182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.570575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.570759] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.571167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.571167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.571314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.571361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.571477] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.925347] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.074477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.074566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.074649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.074940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.075078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.075327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.075456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.075531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.075731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.075813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.075904] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 is going to be updated. [ 1078.103247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.103395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.103498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.103816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.103979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.112918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: IN_PROGRESS for 2s [ 1078.427827] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.428203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.428203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.428322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.428444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.428544] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be updated. [ 1078.465019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.465019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.465019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.465019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.465019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.472641] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: IN_PROGRESS for 2s [ 1078.821879] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1078.822130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.822351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.822577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.822842] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.822940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.822987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.823140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.823222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.823297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.823407] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.330028] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.330202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.330276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.330514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.330681] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.330780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.330842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.330993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.331091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.331180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.331508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.331508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.331508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.331787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.331831] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.331900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.331950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.332110] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.332188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.332272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.332366] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.701167] env[65973]: INFO networking_nsxv3.common.synchronization [req-48bb27ea-2868-4b59-abae-2fa22cff181e req-81e57944-1b56-40bf-aeed-82fa09172533 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1079.701773] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1079.702251] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.702251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.723568] env[65973]: INFO networking_nsxv3.common.synchronization [req-48bb27ea-2868-4b59-abae-2fa22cff181e req-81e57944-1b56-40bf-aeed-82fa09172533 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1079.723852] env[65973]: INFO networking_nsxv3.common.synchronization [req-48bb27ea-2868-4b59-abae-2fa22cff181e req-81e57944-1b56-40bf-aeed-82fa09172533 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1079.723927] env[65973]: INFO networking_nsxv3.common.synchronization [req-48bb27ea-2868-4b59-abae-2fa22cff181e req-81e57944-1b56-40bf-aeed-82fa09172533 tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1079.724640] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_rules [ 1079.724768] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1079.724891] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with Priority: HIGHEST for action port [ 1079.725213] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725560] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.726071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.726293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.726382] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c89e77-71c1-44e2-baa0-2c6d76b4fa8d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.835238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 1079.855478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.855613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.855660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.856663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.856663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.856663] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.856663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.856663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.856663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.856913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.856913] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.856988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.857054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.857222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.857303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.857498] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.857600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.857659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.857852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.857886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.857962] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1079.922794] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.923021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.923141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.923402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.923585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.943428] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1080.125956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 in Status: SUCCESS [ 1080.126222] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 deletion is rescheduled due to dependency. [ 1080.126330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.228454] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d with status ACTIVE [ 1080.228694] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.228834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.228903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.229245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.229410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.230540] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.230540] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.230540] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.230910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.230910] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c89e77-71c1-44e2-baa0-2c6d76b4fa8d is going to be updated. [ 1080.255473] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.255609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.255686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.255957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.256044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.256178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c89e77-71c1-44e2-baa0-2c6d76b4fa8d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.483326] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1080.483664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.483898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.484196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.484402] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.484546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.484626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.484860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.484972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.485089] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.989369] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.491688] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.959040] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1081.959288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.995973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.996338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.996386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.996617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.996765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.996856] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be updated. [ 1082.025279] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.025279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.025279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.025279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.025279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.034473] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: IN_PROGRESS for 2s [ 1083.770083] env[65973]: INFO networking_nsxv3.common.synchronization [req-dc4ae066-a723-4a2c-b0c0-0d9f9907aff5 req-09a8fdd2-6f43-437c-a956-bbfa1a22846f tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1083.770083] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1083.770469] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.770618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.770618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.770755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.770897] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.770988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.771063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.771211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.771315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.771408] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.046963] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1084.046963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.047140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.047261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.047449] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.047565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.047614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.047764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.047838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.048923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.048923] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.048923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.049149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.051641] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.051641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.051886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.052253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.052543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.052974] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.251637] env[65973]: INFO networking_nsxv3.common.synchronization [req-f5d615a1-a1b9-45c4-9f54-390cf840fbdb req-90bc7827-e0bd-4f6e-9f09-8c79d39c0d5e tempest-AttachInterfacesUnderV243Test-1564626729 tempest-AttachInterfacesUnderV243Test-1564626729-project-member] Enqueued Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1084.251637] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd44df49-8634-4dfe-bfa8-3fe62234533b with Priority: HIGHEST for action security_group_members [ 1084.251637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd44df49-8634-4dfe-bfa8-3fe62234533b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.251637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.277107] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.554519] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.559457] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.781905] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.006696] env[65973]: INFO networking_nsxv3.common.synchronization [None req-cb48cd67-7e62-4ad8-a7bc-eaa782407121 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1085.006997] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1085.008362] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.008362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.008362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.008362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.008362] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.058295] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd44df49-8634-4dfe-bfa8-3fe62234533b: rpc.has_security_group_logging(os_id): False [ 1085.063379] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.088997] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.089161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.089237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.090389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.095234] env[65973]: INFO networking_nsxv3.common.synchronization [None req-eb5c8cef-f528-4f04-9c5f-467147497fbb tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1085.095795] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1085.096182] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.096525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.112127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.112493] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.112617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.112686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.112889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.112981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.113078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be updated. [ 1085.175249] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.175249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.175249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.175249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.175249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.191018] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: IN_PROGRESS for 2s [ 1085.285232] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.285232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.285232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.285232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.285232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.285232] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1085.322920] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.323108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.323200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.323427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.323606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.335072] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1085.531079] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.531079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.531079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.531459] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 already deleted. [ 1085.531575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.531743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531999] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.569120] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.569254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.569290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.569508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.569596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.569690] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be updated. [ 1085.597909] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.598085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.598156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.598817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.598964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.611081] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: IN_PROGRESS for 2s [ 1086.058630] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.058981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.058981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.059317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.059475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.059657] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 already deleted. [ 1086.059794] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.241529] env[65973]: INFO networking_nsxv3.common.synchronization [req-f89107f7-28e3-4032-92be-9266ba0ba375 req-50f62b93-ae70-4ac6-89ad-1dba4a16c1ae tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 1086.242140] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGHEST for action security_group_members [ 1086.244661] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.244661] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.244661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.244661] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.749121] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.749121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.749121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.749121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.749625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.749906] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.750024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.750142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.750275] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.750386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.750523] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59c44f2-4848-4042-b55e-827765296b4c is going to be updated. [ 1086.781180] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.781388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.781462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.781677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.781985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.792135] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: IN_PROGRESS for 2s [ 1087.231870] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1087.232652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.232841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.233077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.233172] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.346313] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1087.346656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.624780] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd44df49-8634-4dfe-bfa8-3fe62234533b in Status: SUCCESS [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.624780] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.624780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.624780] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.760714] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.760901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.760901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.761152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.761242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.761418] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be deleted. [ 1087.819033] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.819033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.819313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.819453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.819589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.819793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.126683] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.126882] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.126958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.127330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.127440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.127691] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.127818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.127872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.128095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.128197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.128308] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b is going to be deleted. [ 1088.160350] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.160491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.160580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.160915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.161065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.161178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.161373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.161566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.161752] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.161864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.161930] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.162092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.162171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.162266] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd44df49-8634-4dfe-bfa8-3fe62234533b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.664915] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.664915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.664915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.664915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.664915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.665356] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.665356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.665356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.665484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.665484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.665618] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd44df49-8634-4dfe-bfa8-3fe62234533b already deleted. [ 1088.665659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd44df49-8634-4dfe-bfa8-3fe62234533b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.804307] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59c44f2-4848-4042-b55e-827765296b4c in Status: SUCCESS [ 1088.804420] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59c44f2-4848-4042-b55e-827765296b4c deletion is rescheduled due to dependency. [ 1088.804497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.902860] env[65973]: INFO networking_nsxv3.common.synchronization [req-42a5ea5a-7cf0-4dc4-9b00-701504d862dc req-3721b8cb-abce-4f14-94c4-01998e023bc5 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1090.903433] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1090.903790] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.904251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.904936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.904936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.904936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.904936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.905153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.905188] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.905371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.905423] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.407555] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.910912] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.415243] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.415398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.415471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.415751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.415848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.415950] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1092.445501] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.445710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.445793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.446014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.446240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.459647] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1094.473274] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1094.473657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.718091] env[65973]: INFO networking_nsxv3.common.synchronization [None req-bffa7230-40df-443a-b075-1de581098690 None None] Enqueued Resource ID: 7226de87-2af5-4a61-a99d-73b3e956ff4e with Priority: HIGHEST for action port [ 1095.719544] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7226de87-2af5-4a61-a99d-73b3e956ff4e with Priority: HIGHEST for action port [ 1095.719544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7226de87-2af5-4a61-a99d-73b3e956ff4e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.719544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7226de87-2af5-4a61-a99d-73b3e956ff4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.719544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7226de87-2af5-4a61-a99d-73b3e956ff4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.719544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7226de87-2af5-4a61-a99d-73b3e956ff4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.719544] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7226de87-2af5-4a61-a99d-73b3e956ff4e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.221821] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7226de87-2af5-4a61-a99d-73b3e956ff4e [ 1096.222104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.222351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.222465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.222771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.222915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.223094] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7226de87-2af5-4a61-a99d-73b3e956ff4e already deleted. [ 1096.223237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7226de87-2af5-4a61-a99d-73b3e956ff4e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.356509] env[65973]: INFO networking_nsxv3.common.synchronization [req-da850b64-97c2-4125-8da1-85dd9de25823 req-4eb96a16-6fea-4216-9fc3-230c65f0a58f tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1096.356509] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1096.356509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.356509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.356509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.356509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.356509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.356509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.357210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.357210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.357210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.357210] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.809414] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.809858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.809858] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.810193] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.810489] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.810672] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.810775] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.811021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.811161] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.811574] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.811574] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.811677] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.811771] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.811883] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.811991] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.812162] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.837110] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.837290] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.837441] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.837613] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.837997] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-462c8549-51b2-4261-b3de-2d64b6712538 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.838201] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.838335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.838678] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.838818] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462c8549-51b2-4261-b3de-2d64b6712538',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.860549] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.861096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.861096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.861096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.861247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.861465] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.861570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.861678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.861900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.861998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.862101] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 already deleted. [ 1096.862201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.163241] env[65973]: INFO networking_nsxv3.common.synchronization [None req-15c77f85-1454-4b32-9e6e-c81f7da9c81c tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1097.163241] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1097.163241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.163241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.163241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.163820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.163820] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.342668] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.342903] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.343037] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.343320] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.343703] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.343860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 462c8549-51b2-4261-b3de-2d64b6712538 not found, creating... [ 1097.344229] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.344396] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.344563] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.345268] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.345461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.345815] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.346288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.346288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.346916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.347132] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.347616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 462c8549-51b2-4261-b3de-2d64b6712538 is going to be created. [ 1097.371238] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.371238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.371238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.371620] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.372246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.372246] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.689455] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.689672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.689711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.689978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.690117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.690232] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 already deleted. [ 1097.690321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.079764] env[65973]: INFO networking_nsxv3.common.synchronization [None req-b7f04aa2-8ca1-4288-925a-2ceb96d91d84 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1098.081030] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1098.081030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.081030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.081177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.081394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.081493] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.117814] env[65973]: INFO networking_nsxv3.common.synchronization [req-da850b64-97c2-4125-8da1-85dd9de25823 req-8edc3505-8510-49ed-8bd5-d3921b8cf590 service nova] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1098.117987] env[65973]: INFO networking_nsxv3.common.synchronization [req-da850b64-97c2-4125-8da1-85dd9de25823 req-8edc3505-8510-49ed-8bd5-d3921b8cf590 service nova] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1098.118136] env[65973]: INFO networking_nsxv3.common.synchronization [req-da850b64-97c2-4125-8da1-85dd9de25823 req-8edc3505-8510-49ed-8bd5-d3921b8cf590 service nova] Enqueued Resource ID: 462c8549-51b2-4261-b3de-2d64b6712538 with Priority: HIGHEST for action port [ 1098.118727] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_rules [ 1098.123444] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1098.123444] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462c8549-51b2-4261-b3de-2d64b6712538 with Priority: HIGHEST for action port [ 1098.123444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.123444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.123444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.123444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.123897] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.124472] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.124606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.124677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.124840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.124986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.125102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.125177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.125298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.125367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.125462] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.129013] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-462c8549-51b2-4261-b3de-2d64b6712538 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.129196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.129196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.129353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.129480] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462c8549-51b2-4261-b3de-2d64b6712538',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.378925] env[65973]: INFO networking_nsxv3.common.synchronization [None req-42d3f0ad-f73c-4535-aad7-fb8bc7fa89e1 None None] Enqueued Resource ID: c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b with Priority: HIGHEST for action port [ 1098.379691] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b with Priority: HIGHEST for action port [ 1098.380481] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.380648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.380751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.381079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.381258] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.606789] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.606789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.606789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.606789] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.607076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.607076] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 already deleted. [ 1098.607141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.631930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.632074] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.632271] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.633201] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 462c8549-51b2-4261-b3de-2d64b6712538 with status ACTIVE [ 1098.633386] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.633504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.633572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.633811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.633905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.634097] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.634197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.634250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.634414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.634493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.634674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.634767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.634827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.634967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.636585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.636585] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 462c8549-51b2-4261-b3de-2d64b6712538 is going to be updated. [ 1098.660131] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.660310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.660438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.660654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.660820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.661056] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-462c8549-51b2-4261-b3de-2d64b6712538" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.828456] env[65973]: INFO networking_nsxv3.common.synchronization [req-24c086ab-781b-4de4-a697-49ffb3d87cb8 req-d8b9b56a-6f59-49c9-80d6-f0746f9dfdd0 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1098.828456] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1098.828456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.828456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.828456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.828948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.828948] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.884137] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b [ 1098.884376] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.884509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.884576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.884796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.884883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.884975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b already deleted. [ 1098.885069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1fb346f-88c5-4f13-9a62-ec9b3ce7fc4b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.138022] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.333352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.333422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.333480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.334245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.334245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.334245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.334245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.334245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.334426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.334426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.334481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1099.367558] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.369400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.369400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.369400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.369569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.381407] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1099.641472] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.641710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.641710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.641915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.642037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.642120] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 is going to be created. [ 1099.667672] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.667905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.668046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.668315] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.668533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.680861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: UNINITIALIZED for 2s [ 1101.404258] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1101.404707] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 1101.404707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.694494] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: UNINITIALIZED for 4s [ 1102.284585] env[65973]: INFO networking_nsxv3.common.synchronization [req-e403c7bf-38dd-40c3-8705-353cedd8f0e5 req-e6ee1353-67cc-4c26-8fe7-800e715d6a5a tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 1102.284702] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGHEST for action security_group_members [ 1102.284968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.285111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.285172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.285805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.285805] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.285805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.285805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.286026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.286026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.286026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.791560] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.791936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.791936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.792048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.815238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.815238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.815238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.815238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.815238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.815238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.815238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be updated. [ 1102.845162] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.845319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.845733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.846029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.846201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.858134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: IN_PROGRESS for 2s [ 1103.102714] env[65973]: INFO networking_nsxv3.common.synchronization [req-cfda46bc-2030-490b-ba28-56d0d088f053 req-2f33c28b-8790-4332-a40d-dc76ec601396 tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 1103.104116] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGHEST for action security_group_members [ 1103.104116] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.104116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.104116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.104116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.104456] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.104456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.104456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.104625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.104705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.104816] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.607401] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.607401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.607649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.608021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.608021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.608131] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.608302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.608653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.608869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.608968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.609079] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 is going to be updated. [ 1103.639568] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.639568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.639568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.639897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.639897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.649087] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: IN_PROGRESS for 2s [ 1103.705819] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: SUCCESS [ 1103.706085] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.706254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.706487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.706747] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.706870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.706937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.707182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.707276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.707364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.707455] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.209874] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.713811] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5db36d30-53f7-47b0-ac61-28873c168bb5: rpc.has_security_group_logging(os_id): False [ 1104.741167] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.741496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.741496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.741798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.741927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.742905] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.742905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.742905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.742905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.742905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.743263] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 is going to be created. [ 1104.825617] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.825836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.825938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.826206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.826440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.840642] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: IN_PROGRESS for 2s [ 1104.880115] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 in Status: SUCCESS [ 1104.880368] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 deletion is rescheduled due to dependency. [ 1104.880543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.973919] env[65973]: INFO networking_nsxv3.common.synchronization [req-18d4af98-1485-47a9-ade9-9713e45efeee req-052f4061-7cd5-4bb7-a3f0-ff3fd4bfba90 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1104.975253] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1104.975668] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.975807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.975883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.976135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.976303] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.976489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.976623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.976804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.976961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.977110] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.336170] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.336581] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.336581] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.338558] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.339688] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.339688] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.339889] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.340164] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.340329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.340637] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.340740] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.340860] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.340979] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.341117] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.341259] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.341483] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.364901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.365248] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.365839] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.365839] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-317" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.366178] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.366386] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.366521] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.366868] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.367048] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.480300] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.480470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.480470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.480713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.480788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.480975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.481079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.481136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.481286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.481361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.481492] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1105.509581] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.509749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.509843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.510097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.510273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.523358] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1105.664073] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f771ba6a-073a-4849-9576-cace0561d5e9 in Status: SUCCESS [ 1105.664292] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 deletion is rescheduled due to dependency. [ 1105.664394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.869483] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.869781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.869866] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.870128] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.870281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.870435] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a not found, creating... [ 1105.870700] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.870857] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.870972] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.871207] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.871342] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.871705] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.871855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.872010] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.872238] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.872382] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.872534] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a is going to be created. [ 1105.895605] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.895838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.895957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.896261] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.896491] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.896723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.945576] env[65973]: INFO networking_nsxv3.common.synchronization [req-4d51c2dd-bd19-4e68-a874-3a9fda3f94a5 req-9b7b2979-66c0-41e0-96dd-d8aadc2bbc8d tempest-DeleteServersTestJSON-1988648842 tempest-DeleteServersTestJSON-1988648842-project-member] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1105.946168] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGHEST for action security_group_members [ 1105.946479] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.946608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.946687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.946926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.947183] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.947278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.947342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.947559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.947669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.947768] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.450252] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.450693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.450693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.452299] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.452299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.452299] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be updated. [ 1106.514697] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.514697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.514697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.514697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.514697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.524799] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: IN_PROGRESS for 2s [ 1106.669384] env[65973]: INFO networking_nsxv3.common.synchronization [req-18d4af98-1485-47a9-ade9-9713e45efeee req-dbb41625-73cc-490c-9355-e5f929e1221b service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 1106.669384] env[65973]: INFO networking_nsxv3.common.synchronization [req-18d4af98-1485-47a9-ade9-9713e45efeee req-dbb41625-73cc-490c-9355-e5f929e1221b service nova] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1106.669384] env[65973]: INFO networking_nsxv3.common.synchronization [req-18d4af98-1485-47a9-ade9-9713e45efeee req-dbb41625-73cc-490c-9355-e5f929e1221b service nova] Enqueued Resource ID: 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a with Priority: HIGHEST for action port [ 1106.669630] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_rules [ 1106.669921] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1106.670193] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a with Priority: HIGHEST for action port [ 1106.670813] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.671178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.671415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.671916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.672164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.674012] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.674307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.674739] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.675121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.676377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.676377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.676377] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.853609] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: SUCCESS [ 1106.853853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.178887] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.179059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.179217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a with status ACTIVE [ 1107.179384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.179488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.179549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.179769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.179866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.180055] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.180148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.180211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.180368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.180447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.180628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.180749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.180791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.180910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.180983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.181078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a is going to be updated. [ 1107.204577] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.204763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.204812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.205018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.205160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.205325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a7f3ec2-9553-4fbe-8185-6cbf246c4b0a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.533415] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1107.533769] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 1107.533815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.533984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.534214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.534575] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.534575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.534694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.534748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.534835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.534940] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.037522] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.276515] env[65973]: INFO networking_nsxv3.common.synchronization [req-b2b9993d-303f-44d5-8f0e-d7f544e6e71b req-6cba3dc3-fe9e-47a0-806c-7a74a362985a tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1108.277040] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1108.277339] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.277458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.277531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.277772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.277991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.278111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.278171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.278327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.278414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.278520] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.535145] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 in Status: SUCCESS [ 1108.535492] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 deletion is rescheduled due to dependency. [ 1108.535492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.539894] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.622308] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.622648] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.623257] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.623822] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.623822] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.623994] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.624121] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.624344] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.624482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.624682] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.624957] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.624957] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.625075] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.625106] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.625466] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.625466] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.648380] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.648565] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1108.648706] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.649302] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.649302] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-bb422868-434e-46a4-bbd6-f6cd0db287b5 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.649491] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.649615] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.650182] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.650358] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb422868-434e-46a4-bbd6-f6cd0db287b5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.775033] env[65973]: INFO networking_nsxv3.common.synchronization [req-ce952d82-e7e3-4e32-b3ea-4966b4abeef6 req-5a7fcb7f-43cc-454a-9493-1537075d2a94 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1108.775445] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1108.775771] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.775894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.775985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.776210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.776372] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.776475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.776552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.776715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.776856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.776911] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.780743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.780874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.780927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.781105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.781190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.781380] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.781527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.781619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.781759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.781848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.781946] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 already deleted. [ 1108.782054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.043903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.044072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.044171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.044357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.044446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.044548] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1109.074080] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.074313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.074313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.074502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.074653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.084208] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1109.115451] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.115640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.115778] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.116098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.116377] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.116566] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.116698] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.116953] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.117136] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.117373] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.117518] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.117636] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.117766] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.117895] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.118033] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.118188] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.136302] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.136473] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.136588] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.136762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.137115] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-33c0e2c0-b982-4027-8af5-068ddfc63332 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.137269] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.137388] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.137705] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.137844] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0e2c0-b982-4027-8af5-068ddfc63332',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.152175] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.152385] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.152591] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.152862] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.153024] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.153173] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port bb422868-434e-46a4-bbd6-f6cd0db287b5 not found, creating... [ 1109.153429] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.153605] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.153758] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.153957] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.154108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.154390] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.154538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.154653] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.154856] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.154999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.155151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: bb422868-434e-46a4-bbd6-f6cd0db287b5 is going to be created. [ 1109.182913] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.183151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.183265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.183551] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.183817] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.184070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.279648] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.279815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.279885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.280146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.280273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.280477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.280581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.280643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.280804] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.280879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.280967] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be deleted. [ 1109.322964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.322964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.323239] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.323277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.323367] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.323470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.639866] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.640261] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.640261] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.640522] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.640671] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.640843] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 33c0e2c0-b982-4027-8af5-068ddfc63332 not found, creating... [ 1109.641122] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.641281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.641397] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.641660] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.641820] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.642121] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.642277] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.642414] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.642625] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.642756] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.642892] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 33c0e2c0-b982-4027-8af5-068ddfc63332 is going to be created. [ 1109.663829] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.664102] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.664237] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.664502] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.664792] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.665063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.887091] env[65973]: INFO networking_nsxv3.common.synchronization [req-b2b9993d-303f-44d5-8f0e-d7f544e6e71b req-f0884e37-3333-4f69-bc8a-0fc919c91beb service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1109.890414] env[65973]: INFO networking_nsxv3.common.synchronization [req-b2b9993d-303f-44d5-8f0e-d7f544e6e71b req-f0884e37-3333-4f69-bc8a-0fc919c91beb service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1109.890414] env[65973]: INFO networking_nsxv3.common.synchronization [req-b2b9993d-303f-44d5-8f0e-d7f544e6e71b req-f0884e37-3333-4f69-bc8a-0fc919c91beb service nova] Enqueued Resource ID: bb422868-434e-46a4-bbd6-f6cd0db287b5 with Priority: HIGHEST for action port [ 1109.890414] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1109.890414] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1109.890414] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb422868-434e-46a4-bbd6-f6cd0db287b5 with Priority: HIGHEST for action port [ 1109.890414] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.890414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.890414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.890414] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.890414] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.890879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.890879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.890959] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.891966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.891966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.891966] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.892317] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb422868-434e-46a4-bbd6-f6cd0db287b5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.892442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.892496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.892668] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.892739] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb422868-434e-46a4-bbd6-f6cd0db287b5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.359232] env[65973]: INFO networking_nsxv3.common.synchronization [req-ce952d82-e7e3-4e32-b3ea-4966b4abeef6 req-3737ef15-6e17-41e9-a112-f23e37bc3da0 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1110.359413] env[65973]: INFO networking_nsxv3.common.synchronization [req-ce952d82-e7e3-4e32-b3ea-4966b4abeef6 req-3737ef15-6e17-41e9-a112-f23e37bc3da0 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1110.359547] env[65973]: INFO networking_nsxv3.common.synchronization [req-ce952d82-e7e3-4e32-b3ea-4966b4abeef6 req-3737ef15-6e17-41e9-a112-f23e37bc3da0 service nova] Enqueued Resource ID: 33c0e2c0-b982-4027-8af5-068ddfc63332 with Priority: HIGHEST for action port [ 1110.360144] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1110.360211] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1110.360334] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c0e2c0-b982-4027-8af5-068ddfc63332 with Priority: HIGHEST for action port [ 1110.360573] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.360688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.360749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.360954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.362154] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.367015] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.367015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.367015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.367259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.367602] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.367734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.367814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.368062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.368308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.368308] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.369222] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c0e2c0-b982-4027-8af5-068ddfc63332 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.369331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.369400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.369583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.369758] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0e2c0-b982-4027-8af5-068ddfc63332',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.394241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.394383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.394531] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.395344] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb422868-434e-46a4-bbd6-f6cd0db287b5 with status ACTIVE [ 1110.395518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.395633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.395702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.395903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.395993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.396176] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.396273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.396332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.396486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.396566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.396743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.396832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.396892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.397065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.397108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.397215] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb422868-434e-46a4-bbd6-f6cd0db287b5 is going to be updated. [ 1110.422099] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.422277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.422340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.422568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.422991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.422991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb422868-434e-46a4-bbd6-f6cd0db287b5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.668203] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e4040ff-0c9d-4438-8e1a-7fc19e6293cd req-31c62e31-ac11-4500-b09e-78cf00b889c9 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1110.668872] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1110.669197] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.669379] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.669427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.669613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.669746] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.669849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.669912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.670075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.670166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.670258] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.871239] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.872553] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.872736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.872981] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c0e2c0-b982-4027-8af5-068ddfc63332 with status ACTIVE [ 1110.873164] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.873293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.873361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.873565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.873679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.873855] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.873954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.877548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.878181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.878181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.879281] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.879896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.879896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.880029] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.880893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.881250] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c0e2c0-b982-4027-8af5-068ddfc63332 is going to be updated. [ 1110.898636] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.905730] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.905869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.905935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.906166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.906305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.906469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c0e2c0-b982-4027-8af5-068ddfc63332" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.006979] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.007227] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.007354] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.007639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.008405] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.008593] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.009056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.009383] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.009600] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.009876] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.010053] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.010215] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.010389] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.010551] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.010705] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.010885] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.032189] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.032377] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.032497] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.032770] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.033111] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-4f12d780-2e09-41a5-aed1-69ad3c8529af taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.033285] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.033402] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.033735] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.033904] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f12d780-2e09-41a5-aed1-69ad3c8529af',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.096941] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1111.097250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.097433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.097666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.097872] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.097993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.098071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.098235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.098334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.098403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.098477] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.172484] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.172573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.172611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.172841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.172934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.173149] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.173254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.173305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.173455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.173541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.173616] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be deleted. [ 1111.207314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.207458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.207530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.207732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.207819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.207923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.374205] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.403684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.403883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.403962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.404269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.404378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.404493] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be created. [ 1111.437171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.437171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.437171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.437171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.437171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.448521] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: UNINITIALIZED for 2s [ 1111.537421] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.537667] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.537873] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.538303] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.538387] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.538560] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 4f12d780-2e09-41a5-aed1-69ad3c8529af not found, creating... [ 1111.538858] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.539082] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.539214] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.539444] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.539690] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.539860] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.540059] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.540131] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.540337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.540465] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.540599] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af is going to be created. [ 1111.564427] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.564752] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.564798] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.565061] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.565296] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.565523] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.601336] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.601593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.601638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.601862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.602041] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.602146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.602204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.602359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.602688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.602845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.603031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.603143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.603200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.603359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.603509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.603605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.603670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.603813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.603892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.603976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.604090] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.876579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.876945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.876945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.877073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.877171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.877329] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be created. [ 1111.910943] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.911201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.911308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.911686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.911851] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.927424] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: UNINITIALIZED for 2s [ 1112.106513] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83e6a14-269f-4653-a47c-a9fe58834679: rpc.has_security_group_logging(os_id): False [ 1112.125640] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.125827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.125866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.126267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.126267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.126498] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.126596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.126658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.126825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.126897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.127084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.127175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.127234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.127371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.127446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.127693] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.127935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.127935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.128054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.128054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.128153] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1112.201891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.202080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.202148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.202336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.202513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.223121] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1112.269866] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e4040ff-0c9d-4438-8e1a-7fc19e6293cd req-af515efe-9950-4983-9674-f3c24ff1c8f8 service nova] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_rules [ 1112.269866] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e4040ff-0c9d-4438-8e1a-7fc19e6293cd req-af515efe-9950-4983-9674-f3c24ff1c8f8 service nova] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1112.270325] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e4040ff-0c9d-4438-8e1a-7fc19e6293cd req-af515efe-9950-4983-9674-f3c24ff1c8f8 service nova] Enqueued Resource ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af with Priority: HIGHEST for action port [ 1112.270627] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_rules [ 1112.270716] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1112.272991] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af with Priority: HIGHEST for action port [ 1112.272991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.272991] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.272991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.272991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.273546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.273546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.273546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.273546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.273546] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.273546] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.275187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f12d780-2e09-41a5-aed1-69ad3c8529af taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.276296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.276296] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.276613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.276613] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f12d780-2e09-41a5-aed1-69ad3c8529af',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.778066] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.778341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.778604] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.780687] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f12d780-2e09-41a5-aed1-69ad3c8529af with status ACTIVE [ 1112.780934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.781076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.781152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.781346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.781436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.781638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.781740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.781803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.781955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.782120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.782224] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.782342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.782387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.782808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.782808] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.782808] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af is going to be updated. [ 1112.819822] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.820109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.820109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.820276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.820403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.820719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.097969] env[65973]: INFO networking_nsxv3.common.synchronization [req-26d88002-4f39-4977-be7b-d96c6e944eec req-db4a4c71-4c6c-464b-afab-d63981bd2ccf tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1113.098621] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1113.099214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.099334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.099334] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.099694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.099847] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.100960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.101075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.101284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.101359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.101469] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.283047] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.437052] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.437237] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.437370] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.437675] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.437978] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.438165] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.438289] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.438524] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.438682] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.439342] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.439536] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.439688] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.439800] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.439939] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.440197] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.440197] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.463412] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1113.463803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.464064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.464313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.464620] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.464762] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.464830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.465021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.465108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.465196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.465299] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.482495] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.482495] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.482495] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.482495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.482495] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-95c3a924-3bd5-4160-a67b-0e0194179252 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.482495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.482495] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.482939] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.482939] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95c3a924-3bd5-4160-a67b-0e0194179252',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.604142] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.784567] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.784721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.784795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.785035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.785134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.785234] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be created. [ 1113.812311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.812311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.812311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.812311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.812311] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.821556] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: UNINITIALIZED for 2s [ 1113.938769] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1113.939487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.940314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.940556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.940944] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.940944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.941066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.941178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.941336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.941387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.941529] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.968042] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.985781] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.986075] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.986220] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.986534] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.986719] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.986891] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 95c3a924-3bd5-4160-a67b-0e0194179252 not found, creating... [ 1113.987260] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.987432] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.987550] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.987780] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.987916] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.988216] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.988368] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.988481] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.988686] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.988838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.988984] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 95c3a924-3bd5-4160-a67b-0e0194179252 is going to be created. [ 1114.012783] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.013015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.013189] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.013443] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.013673] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.013903] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.106865] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.241872] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1114.242144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.444332] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.444332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.444332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444707] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.444707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.444707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444976] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.445119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.445305] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.445459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.445459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.445651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.445962] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.445962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.446157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.446421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.446527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.446887] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.446887] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.470756] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ba655d-4cca-4b1f-9029-3a495c9655b1: rpc.has_security_group_logging(os_id): False [ 1114.492836] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.492836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.492836] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.493232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.493328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.493604] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.493715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.493793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.493958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.494045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.494134] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be created. [ 1114.559123] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.559276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.559390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.559687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.573017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1114.610345] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.610345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.610612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.610912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.610912] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.611250] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1114.646318] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.646318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.646318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.646547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.646871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.674823] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1114.732737] env[65973]: INFO networking_nsxv3.common.synchronization [req-26d88002-4f39-4977-be7b-d96c6e944eec req-54f22313-06d1-4b15-8cbb-b32fb095838c service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1114.733041] env[65973]: INFO networking_nsxv3.common.synchronization [req-26d88002-4f39-4977-be7b-d96c6e944eec req-54f22313-06d1-4b15-8cbb-b32fb095838c service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1114.733280] env[65973]: INFO networking_nsxv3.common.synchronization [req-26d88002-4f39-4977-be7b-d96c6e944eec req-54f22313-06d1-4b15-8cbb-b32fb095838c service nova] Enqueued Resource ID: 95c3a924-3bd5-4160-a67b-0e0194179252 with Priority: HIGHEST for action port [ 1114.734122] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1114.734311] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1114.734469] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c3a924-3bd5-4160-a67b-0e0194179252 with Priority: HIGHEST for action port [ 1114.734863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.735038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.735142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.735420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.735537] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.736728] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.737393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.738424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-95c3a924-3bd5-4160-a67b-0e0194179252 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.738424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.738424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.738701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.738815] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95c3a924-3bd5-4160-a67b-0e0194179252',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.949507] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9b235ba-8426-4bfa-b2c5-84500087d8ea: rpc.has_security_group_logging(os_id): False [ 1114.967149] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.967322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.967382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.967607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.967703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.967898] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.968070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.968150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.968309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.968389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.968603] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.968757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.968855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.969026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.969146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.969294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.969390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.969452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.969595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.969669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.969752] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be created. [ 1115.027062] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.027259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.027304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.027486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.027672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.043341] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1115.241187] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.241545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.241588] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95c3a924-3bd5-4160-a67b-0e0194179252 with status ACTIVE [ 1115.241755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.241862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.241928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.242158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.242248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.242415] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.242510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.242573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.242768] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.242809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.242981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.243083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.243143] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.243287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.243361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.243443] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95c3a924-3bd5-4160-a67b-0e0194179252 is going to be updated. [ 1115.268543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.268685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.268758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.268971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.269121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.269279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95c3a924-3bd5-4160-a67b-0e0194179252" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.760896] env[65973]: INFO networking_nsxv3.common.synchronization [None req-5bef37e1-773a-4c5e-a539-99ec4f7ec37a tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1115.761673] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1115.762883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.762883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.763063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.763605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.763605] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.763605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.763605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.767116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.767116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.767116] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.834354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.835558] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.835558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.836095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.836095] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.268577] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.337674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.337824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.337899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.338228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.338416] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.338524] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.338594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.338756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.338841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.338929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.339091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.339216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.339246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.339410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.339518] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.339624] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.339656] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.339814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.339853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.339957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.340025] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.588750] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1116.589047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.688272] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1116.688556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.688753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.688995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.689209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.689374] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.689507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.689680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.689727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.689872] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.771064] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.842801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75299a7e-f943-422d-b243-adb623b647de: rpc.has_security_group_logging(os_id): False [ 1116.864033] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.864217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.864293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.864601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.865672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.865672] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.865672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.865672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.865672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.865672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.866111] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.866255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.866317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.866474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.866558] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.866743] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.866868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.866948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.867114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.867185] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.867266] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be created. [ 1116.942081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.942405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.942581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.942990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.943427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.962288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: IN_PROGRESS for 2s [ 1117.058304] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1117.058560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.192502] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.274071] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.274071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.274557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.274557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.274557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.274557] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1117.304560] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.304560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.304560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.304560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.304560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.312214] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1117.695704] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.938980] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.938980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.938980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.938980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.939243] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.939297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.939404] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.939659] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.939795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.940046] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.940155] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.940258] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.940358] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.940459] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.940557] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.940688] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.961118] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.961494] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.961759] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.962106] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.962640] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-acc56d97-a170-4b89-bc16-a8275248665c taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.962928] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.963152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.963639] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.963881] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc56d97-a170-4b89-bc16-a8275248665c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.197981] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.197981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.197981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.197981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.197981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.197981] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1118.227871] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.228027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.228027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.228262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.228431] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.238126] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1118.466241] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.466699] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.466699] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.466886] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.467076] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.467243] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port acc56d97-a170-4b89-bc16-a8275248665c not found, creating... [ 1118.467514] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.467678] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.467809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.468039] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.468182] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.468537] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.468716] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.468832] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.469068] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.469188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.469329] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: acc56d97-a170-4b89-bc16-a8275248665c is going to be created. [ 1118.495515] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.495804] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.495947] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.496347] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.496551] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.496835] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.687787] env[65973]: INFO networking_nsxv3.common.synchronization [None req-4373790b-9aa9-4918-8ffa-24de1ba6502b tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1118.689552] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1118.690107] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.690287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.690380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.690760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.690887] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.824052] env[65973]: INFO networking_nsxv3.common.synchronization [None req-600adaa4-99ec-47e5-bb09-9f0465e08a07 tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1118.824621] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1118.824944] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.825129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.977363] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 1118.977446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.999572] env[65973]: INFO networking_nsxv3.common.synchronization [req-c0511437-306a-439a-a0e7-fed073da0717 req-9c52f341-f765-4b02-9599-1ac0a296bc18 tempest-ServerDiskConfigTestJSON-1052909346 tempest-ServerDiskConfigTestJSON-1052909346-project-member] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1119.000135] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGHEST for action security_group_members [ 1119.000448] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.001164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.001164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.001164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.001164] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.001596] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.001709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.002492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.002492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.002492] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.212666] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.212898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.213014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.213264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.213368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.213469] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb already deleted. [ 1119.213562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.213730] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.213898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.213968] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.239602] env[65973]: INFO networking_nsxv3.common.synchronization [req-58a71652-1f36-4e1f-99e3-de30f4af4f5d req-0c97f54b-bad0-4a03-a8fa-3c6139371edd service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1119.239926] env[65973]: INFO networking_nsxv3.common.synchronization [req-58a71652-1f36-4e1f-99e3-de30f4af4f5d req-0c97f54b-bad0-4a03-a8fa-3c6139371edd service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1119.239926] env[65973]: INFO networking_nsxv3.common.synchronization [req-58a71652-1f36-4e1f-99e3-de30f4af4f5d req-0c97f54b-bad0-4a03-a8fa-3c6139371edd service nova] Enqueued Resource ID: acc56d97-a170-4b89-bc16-a8275248665c with Priority: HIGHEST for action port [ 1119.240690] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1119.240690] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1119.240690] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc56d97-a170-4b89-bc16-a8275248665c with Priority: HIGHEST for action port [ 1119.240975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.241128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.241162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.241371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.241503] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.242422] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.242499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.242675] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc56d97-a170-4b89-bc16-a8275248665c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.242818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.242868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.243166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.243353] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc56d97-a170-4b89-bc16-a8275248665c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.323951] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1119.324267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.324474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.324713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325065] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.325129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.325160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.325327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.325542] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.504501] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.504938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.504938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.505807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.505807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.505807] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.505807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.505807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.506092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.506092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.506092] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be updated. [ 1119.537788] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.537788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.537788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.537788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.537788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.552803] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: IN_PROGRESS for 2s [ 1119.734783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.734947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.735062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.735270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.735316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.735400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb already deleted. [ 1119.735497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.745087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.745216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.745419] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acc56d97-a170-4b89-bc16-a8275248665c with status ACTIVE [ 1119.745597] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.745708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.745773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.745981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.746086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.746266] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.746364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.746426] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.746590] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.746671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.746901] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.746945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.747107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.747168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.747244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.747300] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acc56d97-a170-4b89-bc16-a8275248665c is going to be updated. [ 1119.774923] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.775135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.775135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.775342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.775477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.775641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc56d97-a170-4b89-bc16-a8275248665c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.828704] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.249512] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1120.249807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.250038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.250324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.250584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.250766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.250848] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.251101] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.251235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.251359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.251550] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.331233] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.754175] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.754948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.755098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.755335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.755528] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.755643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.755709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.757314] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.757314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.758281] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.758281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.758281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.758503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.758664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.758791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.758907] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.838024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.838024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.838024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.838024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.838024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.838024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1120.868657] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.868937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.869047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.869844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.869844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.883085] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1121.261775] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 1121.282024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.282230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.282230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.282437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.282534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.282734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.282834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.282899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.283071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.283151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.283399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.283498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.283561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.283706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.283780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.284019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.284119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.284180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.284321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.284396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.284478] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1121.449220] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.449449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.449449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.449600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.449749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.466438] env[65973]: INFO networking_nsxv3.common.synchronization [req-5db88823-c2da-42f1-90da-be3946740c9f req-28f9b97e-77fb-4654-a2a5-860fb23c0108 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1121.467042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGHEST for action security_group_members [ 1121.467358] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.467480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.467551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.467744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.467901] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.467991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.468089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.468253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.468351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.468447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.485524] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1121.531024] env[65973]: INFO networking_nsxv3.common.synchronization [req-5db88823-c2da-42f1-90da-be3946740c9f req-28f9b97e-77fb-4654-a2a5-860fb23c0108 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af with Priority: HIGHEST for action port [ 1121.531024] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af with Priority: HIGHEST for action port [ 1121.532101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f12d780-2e09-41a5-aed1-69ad3c8529af taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.532333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.532398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.533640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.533640] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f12d780-2e09-41a5-aed1-69ad3c8529af',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.562937] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83e6a14-269f-4653-a47c-a9fe58834679 in Status: SUCCESS [ 1121.563189] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 deletion is rescheduled due to dependency. [ 1121.563539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.971369] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.971809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.971809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.971919] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.972031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.972263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.972345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.972450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.972550] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.972631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.972703] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be updated. [ 1122.010026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.010203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.010254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.010459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.010603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.019771] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: IN_PROGRESS for 2s [ 1122.034844] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f12d780-2e09-41a5-aed1-69ad3c8529af with status ACTIVE [ 1122.035280] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.035400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.035555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.035676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.035774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.035969] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.036090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.036156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.036338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.036451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.036620] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.036714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.036774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.036954] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.037385] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.037385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f12d780-2e09-41a5-aed1-69ad3c8529af is going to be updated. [ 1122.082464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.082700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.082751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.083025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.083204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.084063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f12d780-2e09-41a5-aed1-69ad3c8529af" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.893358] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1122.893583] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.893754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.894009] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.894215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.894333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.894395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.894557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.894638] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.894723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.894828] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.396678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.397124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.397124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.397124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.397295] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.397455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.397455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.397654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.397714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.397797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.397998] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.398114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.398165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.398375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.398453] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.398515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.398562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.398693] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.398765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.398819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.398969] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.501238] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1123.501556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.901660] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9b235ba-8426-4bfa-b2c5-84500087d8ea: rpc.has_security_group_logging(os_id): False [ 1123.928109] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.928297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.928341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.928561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.928662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.928866] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.928966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.929039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.929281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.929396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.929619] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.929711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.929774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.929923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.929998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.930194] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.930286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.930346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.930484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.930559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.930646] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1124.001231] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.001911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.001991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.002227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.002381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.022051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1124.033069] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75299a7e-f943-422d-b243-adb623b647de in Status: SUCCESS [ 1124.033271] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75299a7e-f943-422d-b243-adb623b647de deletion is rescheduled due to dependency. [ 1124.033337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.041257] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1126.041597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.532698] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1126.532904] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1126.850842] env[65973]: INFO networking_nsxv3.common.synchronization [req-8ec09037-4820-427d-b784-026f9d4dceb1 req-3076bc35-ab66-40a2-b798-2b068c168796 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1126.851377] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1126.851757] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.851886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.851957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.852147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.852293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.852410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.852468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.852733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.852819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.852914] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.076125] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e35a872-f7ae-4073-b4be-2d2b2b29add1 req-98b392e8-f28c-43e0-823b-7b18cf3c40a2 tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 1127.076125] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 1127.076125] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.076125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.076125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.076125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.076125] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.076125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.076125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.076664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.076664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.076664] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.355638] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.465178] env[65973]: INFO networking_nsxv3.common.synchronization [req-81cd218b-c161-4551-85e6-e3b1f82cc81f req-1ff7ed42-4287-4da1-8a54-f060eca551ad tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1127.465584] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1127.466074] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.467760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.467977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.468553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.469889] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.469889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.469889] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.470277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.470557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.470774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.579119] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.835555] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.835713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.835770] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.836098] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.836388] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.836618] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.836781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.837037] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.837393] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.837479] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.837539] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.837677] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.837804] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.837931] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.838177] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.838177] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.856829] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.858483] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.858650] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.858785] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.858967] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.859303] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.859472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.859603] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.859917] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.860079] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0dc9d8-ebbc-4147-ab56-7605a00cc18d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.973776] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.974079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.974162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.974449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.974618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.974934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.975102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.975180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.975435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.975572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.975719] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb already deleted. [ 1127.975876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.081973] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.362197] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.362410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.362460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.362910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.362910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.362981] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1128.364499] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.364920] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.364920] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.365112] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.365263] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.365424] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port ba0dc9d8-ebbc-4147-ab56-7605a00cc18d not found, creating... [ 1128.365693] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.365935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.366134] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.366389] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.366527] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.366864] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.367058] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.367231] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.367494] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.367635] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.367802] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d is going to be created. [ 1128.398567] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.398897] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.398999] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.399349] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.399687] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.399935] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.414030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.414030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.414030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.414380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.414380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.428392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1128.584568] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.584568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.584568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.584793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.584793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.584848] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be updated. [ 1128.619579] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.619785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.619785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.620089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.620139] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.629970] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 1129.097477] env[65973]: INFO networking_nsxv3.common.synchronization [req-81cd218b-c161-4551-85e6-e3b1f82cc81f req-3be4c110-6048-43dd-a862-9e4dd4587799 service nova] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1129.097726] env[65973]: INFO networking_nsxv3.common.synchronization [req-81cd218b-c161-4551-85e6-e3b1f82cc81f req-3be4c110-6048-43dd-a862-9e4dd4587799 service nova] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1129.097806] env[65973]: INFO networking_nsxv3.common.synchronization [req-81cd218b-c161-4551-85e6-e3b1f82cc81f req-3be4c110-6048-43dd-a862-9e4dd4587799 service nova] Enqueued Resource ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with Priority: HIGHEST for action port [ 1129.098542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1129.098542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1129.098623] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with Priority: HIGHEST for action port [ 1129.098903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.099105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.099105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.099331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.099398] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.100316] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.100683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.100683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.100683] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.101108] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.101108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.101108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.101108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.101304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.101304] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.102017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.103202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.103202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.103364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.103516] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0dc9d8-ebbc-4147-ab56-7605a00cc18d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.605751] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.605932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.606155] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.607126] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with status ACTIVE [ 1129.607311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.607441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.607517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.607728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.607816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.607986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.608091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.608150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.608297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.608376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.608585] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.608679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.608737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.608886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.608958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.609051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d is going to be updated. [ 1129.629473] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.629613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.629703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.629893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.630044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.630205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.112178] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.119139] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.119425] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.119602] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.120123] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.120563] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.120846] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.121025] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.121322] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.121500] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.121788] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.121946] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.122183] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.122368] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.122532] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.122705] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.122888] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.149648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.149856] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.150072] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.150259] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-154" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.150627] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.150838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.150986] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.151306] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.151470] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f9d4a6-ecf6-468e-98b8-d9b4c64dea91',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.439593] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1130.439840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.616566] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.616743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.616876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.617086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.617182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.617256] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be created. [ 1130.640996] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.640996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.640996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.640996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.640996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.642450] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 1130.642651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.649829] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: UNINITIALIZED for 2s [ 1130.654445] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.654667] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.654743] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.654996] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.655152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.655427] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.655609] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.655728] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.655960] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.656103] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.656380] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.656533] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.656642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.656843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.656971] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.657113] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 is going to be updated. [ 1130.677693] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.677913] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.678047] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.678321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.678524] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.678814] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.383379] env[65973]: INFO networking_nsxv3.common.synchronization [req-7804b913-0155-4c8e-8a83-7bac2f8246ff req-00f84129-b6a4-4244-915d-6000f26582e7 service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1131.383379] env[65973]: INFO networking_nsxv3.common.synchronization [req-7804b913-0155-4c8e-8a83-7bac2f8246ff req-00f84129-b6a4-4244-915d-6000f26582e7 service nova] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1131.383714] env[65973]: INFO networking_nsxv3.common.synchronization [req-7804b913-0155-4c8e-8a83-7bac2f8246ff req-00f84129-b6a4-4244-915d-6000f26582e7 service nova] Enqueued Resource ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with Priority: HIGHEST for action port [ 1131.383946] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_rules [ 1131.384542] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1131.384701] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with Priority: HIGHEST for action port [ 1131.385050] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.385210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.385299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.385519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.385624] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.386734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.386929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.386929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.387107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.387554] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.387554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.387554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.387996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.387996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.387996] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.388860] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.388860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.388860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.389013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.389352] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f9d4a6-ecf6-468e-98b8-d9b4c64dea91',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.799280] env[65973]: INFO networking_nsxv3.common.synchronization [req-67012ae0-254f-42fa-b7b1-a4ae420d91bc req-40e34370-a756-4006-a099-c1408c674282 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1131.801614] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1131.801614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.801614] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.801614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.801614] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.891335] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.892390] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.892495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.892681] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 with status ACTIVE [ 1131.892934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.893068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.893137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.893353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.893435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.893607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.893725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.893793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.893977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.894062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.894245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.894336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.894394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.894531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.894602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.894683] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25f9d4a6-ecf6-468e-98b8-d9b4c64dea91 is going to be updated. [ 1131.915832] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.916041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.916171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.916391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.916556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.916936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25f9d4a6-ecf6-468e-98b8-d9b4c64dea91" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.304062] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.396472] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.477471] env[65973]: INFO networking_nsxv3.common.synchronization [req-3fb76041-6dc0-4a75-a7f0-8db63b0c4bd7 req-ff9acfa2-76cc-4754-b412-ff99e4bc4c35 tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1132.477981] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1132.478444] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.478629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.478743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.479012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.479192] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.479293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.479369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.479568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.479689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.479795] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.661893] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: SUCCESS [ 1132.662391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.662391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.662580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.662782] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.662908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.662967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.663161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.663235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.663318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.663405] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.807169] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.899275] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.899466] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.899510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.899795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.899894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.899996] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1132.945901] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.945901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.945901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.945901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.945901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.959219] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1132.982191] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.982368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.982444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.982862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.011293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.011703] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.011879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.011978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.012565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.012565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.012565] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1133.053026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.053026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.053026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.053026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.053026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.062603] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1133.147026] env[65973]: INFO networking_nsxv3.common.synchronization [None req-cc66708c-2c10-4b5d-a91f-daa3fd2e50ed tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1133.147026] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1133.147026] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.148128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.168417] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.309539] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.309816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.309816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.310036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.310125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.310231] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1133.352275] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.352670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.352670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.352828] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.352991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.365014] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1133.668732] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1988574b-e8ea-411d-ac4f-bf196438bafb: rpc.has_security_group_logging(os_id): False [ 1133.690440] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.690654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.690654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.690853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.690943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.691201] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.691293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.691389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.691514] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.691615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.691714] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be created. [ 1133.795509] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.795509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.795509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.795509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.795884] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.818549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: IN_PROGRESS for 2s [ 1134.971532] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1134.972014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.972014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.972199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.972393] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.972506] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.972791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.972791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.972862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.972933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.973033] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.073018] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1135.073191] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec deletion is rescheduled due to dependency. [ 1135.073302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.377498] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1135.377735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.377917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.378203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.378419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.378552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.378626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.378822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.378926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.379065] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.476232] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.476485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.476485] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.476732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.476955] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.477161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.477297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.477535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.477699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.477866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.478073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.478204] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.478300] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.478471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.478684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.478807] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.478908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.479178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.479294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.479409] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.479561] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.832672] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: SUCCESS [ 1135.833140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.882466] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.882657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.882698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.883027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.883153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.883353] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.883460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.883519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.883685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.883822] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.883875] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1135.915865] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.916102] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.916214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.916347] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.916497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.927861] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1135.982511] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29: rpc.has_security_group_logging(os_id): False [ 1136.003044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.003044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.003044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.003345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.003389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.003741] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.003992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.004109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.004342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.004432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.004660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.004765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.004837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.004980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.005261] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.005377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.005451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.005636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.005826] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1136.080699] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.080908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.080908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.081148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.081295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.093725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1136.775078] env[65973]: INFO networking_nsxv3.common.synchronization [req-82d969cb-be45-4ef6-b677-dcfa21699e22 req-a6a11a48-ee8e-4699-9069-2587f64755d5 tempest-ServerRescueNegativeTestJSON-180903145 tempest-ServerRescueNegativeTestJSON-180903145-project-member] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 1136.775703] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGHEST for action security_group_members [ 1136.776372] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.776508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.776592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.777147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.777344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.777457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.777522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.777728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.777819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.777933] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.281044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.281447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.281447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.281513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.301685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.301946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.303015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.303015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.303015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.303015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.303015] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be updated. [ 1137.329714] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.329891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.329891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.330103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.330247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.338604] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: IN_PROGRESS for 2s [ 1137.939151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1137.939473] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea deletion is rescheduled due to dependency. [ 1137.939473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.135026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1138.135263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.352275] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 in Status: SUCCESS [ 1139.352657] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 deletion is rescheduled due to dependency. [ 1139.352657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.945482] env[65973]: INFO networking_nsxv3.common.synchronization [req-55cb7dd4-ffa2-4e6d-8ba4-c7d4e4404ad6 req-150db642-fe66-4112-90b9-75f465643512 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1139.946298] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1139.946982] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.946982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.946982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.947319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.947679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.947810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.947877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.948170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.948170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.948393] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.282241] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.282455] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.282559] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.282882] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.283186] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.283349] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.283465] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.283685] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.283830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.284197] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.284347] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.284458] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.284564] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.284675] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.284783] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.284908] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.304169] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.304337] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.304474] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.304651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-273" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.304962] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.305148] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.305267] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.305628] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.305790] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5451f02-dbe1-4d17-aaf6-389ec7c64b6f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.454385] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.808373] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.808638] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.808683] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.808984] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.809160] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.809315] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port e5451f02-dbe1-4d17-aaf6-389ec7c64b6f not found, creating... [ 1140.809571] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.809786] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.809871] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.810101] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.810240] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.810516] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.810668] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.810781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.810984] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.811130] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.811264] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: e5451f02-dbe1-4d17-aaf6-389ec7c64b6f is going to be created. [ 1140.832259] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.832537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.832537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.832777] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.832998] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.833227] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.956927] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.459852] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.460115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.460115] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.460263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.460356] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.460460] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1141.501398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.501588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.501651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.501924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.502088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.512593] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1141.572671] env[65973]: INFO networking_nsxv3.common.synchronization [req-55cb7dd4-ffa2-4e6d-8ba4-c7d4e4404ad6 req-ce50e687-ee20-490f-8546-b2dbe3b9138a service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1141.572671] env[65973]: INFO networking_nsxv3.common.synchronization [req-55cb7dd4-ffa2-4e6d-8ba4-c7d4e4404ad6 req-ce50e687-ee20-490f-8546-b2dbe3b9138a service nova] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1141.572671] env[65973]: INFO networking_nsxv3.common.synchronization [req-55cb7dd4-ffa2-4e6d-8ba4-c7d4e4404ad6 req-ce50e687-ee20-490f-8546-b2dbe3b9138a service nova] Enqueued Resource ID: e5451f02-dbe1-4d17-aaf6-389ec7c64b6f with Priority: HIGHEST for action port [ 1141.573256] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_rules [ 1141.573401] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1141.573500] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5451f02-dbe1-4d17-aaf6-389ec7c64b6f with Priority: HIGHEST for action port [ 1141.574047] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.574047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.574047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.574270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.574347] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.575322] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.575423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.575642] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.575728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.575844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.575950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.576040] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5451f02-dbe1-4d17-aaf6-389ec7c64b6f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.043680] env[65973]: INFO networking_nsxv3.common.synchronization [req-1a18db00-6137-45f4-bfb5-260942721500 req-00785b32-a8ac-4892-a6ae-b88705b2fe7a tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1142.043894] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGHEST for action security_group_members [ 1142.044663] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.044663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.044663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.044663] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.044883] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.044883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.044883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.045472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.045472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.045472] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.078230] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.078363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.078510] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5451f02-dbe1-4d17-aaf6-389ec7c64b6f with status ACTIVE [ 1142.078670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.078780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.078845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.079070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.079164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.079325] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.079469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.079469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.079659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.079742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.079928] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.080022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.080076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.080221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.080294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.080373] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5451f02-dbe1-4d17-aaf6-389ec7c64b6f is going to be updated. [ 1142.104197] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.104416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.104416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.104608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.104780] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.104945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5451f02-dbe1-4d17-aaf6-389ec7c64b6f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.548214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.548564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.548564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.548652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.548744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.548930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.549036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.549116] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.549246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.549322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.549409] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 is going to be updated. [ 1142.581653] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.581653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.581653] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.581834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.581957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.594712] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: IN_PROGRESS for 2s [ 1143.526038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1143.526038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.526220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.526430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.526618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.526746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.526812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.527073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.527169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.527266] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.029426] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.533739] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.605396] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 in Status: SUCCESS [ 1144.605578] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 deletion is rescheduled due to dependency. [ 1144.605855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.037255] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.037255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.037255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.037255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.037255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.037721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1145.068843] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.071706] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.071899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.072235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.072346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.084030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1146.644053] env[65973]: INFO networking_nsxv3.common.synchronization [req-d1d66994-2d62-4e28-bd2c-908b4ad4c554 req-7065b9e4-1a7a-4f8a-a7c7-3b0c62129506 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1146.644553] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1146.644903] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.645039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.645107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.645306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.645461] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.645555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.645617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.645764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.645847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.645948] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.962120] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.962330] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.962394] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.962674] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.962904] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.963071] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.963367] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.963453] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.963528] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.963759] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.963834] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.963939] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.964105] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.964176] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.964281] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.964407] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.985291] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.985475] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.985578] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.985722] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-885" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.986048] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.986221] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.986337] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.986914] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.986914] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5c33642-a36c-4b4e-bb8a-0d7967bdfd06',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.094637] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1147.094905] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.095457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.095696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.095894] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.096014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.096158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.096326] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.096408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.096494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.096582] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.147675] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.491253] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.491253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.491253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.491253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.491253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.491253] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 not found, creating... [ 1147.491253] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.491253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.493209] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.493209] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.493565] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.493565] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 is going to be created. [ 1147.516479] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.516723] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.516848] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.517172] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.517506] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.517823] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.598754] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.598754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.598982] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.599057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.599729] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.599729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.599729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.599729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.599729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.599729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.600031] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.600031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.600109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.601307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.601307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.601307] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.650756] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.103312] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7b78e3-6775-4a75-a625-09d47728d125: rpc.has_security_group_logging(os_id): False [ 1148.123892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.123892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.123892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.124124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.124124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.124899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.124899] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.124899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.125973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.125973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.125973] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1148.153501] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.153714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.153830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.154403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.154403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.154545] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1148.184311] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.184497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.184561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.184824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.184942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.194800] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1148.219310] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.219474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.219520] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.219863] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.219959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.239336] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1148.250158] env[65973]: INFO networking_nsxv3.common.synchronization [req-d1d66994-2d62-4e28-bd2c-908b4ad4c554 req-28c42361-7167-4cba-8c83-4dc0a879342a service nova] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 1148.250324] env[65973]: INFO networking_nsxv3.common.synchronization [req-d1d66994-2d62-4e28-bd2c-908b4ad4c554 req-28c42361-7167-4cba-8c83-4dc0a879342a service nova] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1148.250457] env[65973]: INFO networking_nsxv3.common.synchronization [req-d1d66994-2d62-4e28-bd2c-908b4ad4c554 req-28c42361-7167-4cba-8c83-4dc0a879342a service nova] Enqueued Resource ID: a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 with Priority: HIGHEST for action port [ 1148.250969] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_rules [ 1148.251238] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1148.251238] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 with Priority: HIGHEST for action port [ 1148.251755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.251886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.252114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.252324] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.252401] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.253278] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.253366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.253548] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.253643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.253700] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.253877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.253950] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5c33642-a36c-4b4e-bb8a-0d7967bdfd06',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.698419] env[65973]: INFO networking_nsxv3.common.synchronization [None req-108fffc6-8f89-4fe8-87da-d06c448ed719 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1148.699089] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1148.699467] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.699610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.699752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.700307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.700434] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.755802] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.755993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.757098] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 with status ACTIVE [ 1148.757098] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.757098] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.757098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.757500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.757500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.757500] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.757607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.757640] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.757834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.757938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.758122] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5c33642-a36c-4b4e-bb8a-0d7967bdfd06 is going to be updated. [ 1148.788081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.788339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.788339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.788670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.788670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.788795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5c33642-a36c-4b4e-bb8a-0d7967bdfd06" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.808390] env[65973]: INFO networking_nsxv3.common.synchronization [None req-1e98e4fa-586a-4f65-a303-1f95335f4edc tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1148.808991] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1148.809361] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.809447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.223664] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.223815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.223847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.224154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.224254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.224349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b already deleted. [ 1149.224522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.224735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.224943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.225052] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.749383] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.749772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.749840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.750108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.750215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.750325] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b already deleted. [ 1149.750410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.206701] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1150.206923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.207112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.207337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.207527] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.207643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.207720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.207895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.207986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.208104] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.258029] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1150.258190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.711145] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.715583] env[65973]: INFO networking_nsxv3.common.synchronization [req-086b6315-2fd8-49b2-94f5-783d3607babf req-0b9e6732-6123-4daa-95e1-6bebd7bfe24d tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1150.717547] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1150.717547] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.717547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.717678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.717783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.717952] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.718309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.718309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.718309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.718419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.718484] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.020262] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.020262] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.020262] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.021174] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.021369] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.021495] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.021607] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.021744] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.021855] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.021995] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.043552] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.043727] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.043901] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.044052] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.044342] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-8d408943-5a9d-43d2-9ed3-5d0e86343b58 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.044513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.044628] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.044956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.045109] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d408943-5a9d-43d2-9ed3-5d0e86343b58',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.213048] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.222631] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.222902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.222989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.223307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.223439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.223715] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.223834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.223924] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.224180] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.224267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.224357] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1151.252394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.252394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.252744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.252744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.252832] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.268831] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1151.547398] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.547661] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.547795] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.548227] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.548435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.548632] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 8d408943-5a9d-43d2-9ed3-5d0e86343b58 not found, creating... [ 1151.549013] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.549242] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.549400] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.549731] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.549901] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.550253] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.550461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.550615] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.550908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.551090] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.551267] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 is going to be created. [ 1151.584833] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.585083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.585193] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.585508] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.585890] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.586202] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.715586] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.715740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.715820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.716108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.716208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.716317] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1151.754432] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.754652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.754652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.754883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.755068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.775421] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1152.292388] env[65973]: INFO networking_nsxv3.common.synchronization [req-086b6315-2fd8-49b2-94f5-783d3607babf req-239ead22-849a-4dcf-9ee4-4a73388fb3da service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1152.292697] env[65973]: INFO networking_nsxv3.common.synchronization [req-086b6315-2fd8-49b2-94f5-783d3607babf req-239ead22-849a-4dcf-9ee4-4a73388fb3da service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1152.293578] env[65973]: INFO networking_nsxv3.common.synchronization [req-086b6315-2fd8-49b2-94f5-783d3607babf req-239ead22-849a-4dcf-9ee4-4a73388fb3da service nova] Enqueued Resource ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with Priority: HIGHEST for action port [ 1152.293989] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1152.294186] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1152.294314] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with Priority: HIGHEST for action port [ 1152.294655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.294785] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.294850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.295078] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.295183] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.296071] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.296172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.296374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d408943-5a9d-43d2-9ed3-5d0e86343b58 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.296479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.296535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.296966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.296966] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d408943-5a9d-43d2-9ed3-5d0e86343b58',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.798431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.798609] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.798795] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with status ACTIVE [ 1152.799068] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.799259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.799344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.799556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.799687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.799863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.799960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.800670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.800670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.800670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.800670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.800878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.800878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.800998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.800998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.801116] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 is going to be updated. [ 1152.836742] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.836840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.836877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.837099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.837281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.837501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.283151] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1153.283523] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec deletion is rescheduled due to dependency. [ 1153.283761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.284183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.284576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.284925] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.285235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.285312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.285556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.285746] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.286048] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.785512] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1153.785802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.786066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.786302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.786500] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.786616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.786681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.786835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.786918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.787011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.787121] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.788808] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.291042] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.292366] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.524310] env[65973]: INFO networking_nsxv3.common.synchronization [req-60aa5490-c39c-48bc-8245-6dfa59b14534 req-7efb3a14-8501-4c17-9d1d-ce3ab2a67346 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1154.525146] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1154.525564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.525747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.526934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.526934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.526934] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.526934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.526934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.526934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.527921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.527921] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.796419] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.796865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.796933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.797240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.797388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.797492] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1154.798806] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8da0d868-de85-4818-aa51-4d52389cba32: rpc.has_security_group_logging(os_id): False [ 1154.821892] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.821979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.822103] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.822351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.822452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.822794] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.822855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.822941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.823104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.823196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.823301] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1154.839670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.839906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.839971] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.840155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.840304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.849901] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1154.874745] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.874944] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.875079] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.875359] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.875613] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.876051] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.876177] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.876439] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.876640] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.876915] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.877102] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.877264] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.877416] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.877572] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.877718] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.877893] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.893235] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.893406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.893456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.893674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.893847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.896609] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.896846] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1154.897043] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.897258] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.897595] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-1f4db00a-f918-46f5-a9cd-748e3aaaae70 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.897830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.898033] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.898367] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.898560] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f4db00a-f918-46f5-a9cd-748e3aaaae70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.924089] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1155.031293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.031293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.031293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.031626] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b already deleted. [ 1155.031626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.404038] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.404038] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 1f4db00a-f918-46f5-a9cd-748e3aaaae70 not found, creating... [ 1155.404038] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.404038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.404782] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.404782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.404782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.404782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.404782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.404782] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 1f4db00a-f918-46f5-a9cd-748e3aaaae70 is going to be created. [ 1155.426851] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.427087] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.427180] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.427483] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.427734] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.427959] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.138194] env[65973]: INFO networking_nsxv3.common.synchronization [req-60aa5490-c39c-48bc-8245-6dfa59b14534 req-7e9590a9-d843-4637-9e5d-519245efffce service nova] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1156.138194] env[65973]: INFO networking_nsxv3.common.synchronization [req-60aa5490-c39c-48bc-8245-6dfa59b14534 req-7e9590a9-d843-4637-9e5d-519245efffce service nova] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1156.138194] env[65973]: INFO networking_nsxv3.common.synchronization [req-60aa5490-c39c-48bc-8245-6dfa59b14534 req-7e9590a9-d843-4637-9e5d-519245efffce service nova] Enqueued Resource ID: 1f4db00a-f918-46f5-a9cd-748e3aaaae70 with Priority: HIGHEST for action port [ 1156.138194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1156.138194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1156.138645] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4db00a-f918-46f5-a9cd-748e3aaaae70 with Priority: HIGHEST for action port [ 1156.138727] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.138841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.138914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.139125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.139206] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.140129] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.140214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.140283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.140475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.140626] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.140742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.140886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.141026] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.141080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.141194] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.142327] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f4db00a-f918-46f5-a9cd-748e3aaaae70 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.142327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.142327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.142327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.142804] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f4db00a-f918-46f5-a9cd-748e3aaaae70',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.336714] env[65973]: INFO networking_nsxv3.common.synchronization [req-75e2e355-5999-4f0a-8899-ae95766afdbe req-f818c39c-1879-40c7-8c6e-16fd16f37a4e tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1156.337288] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1156.337621] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.337760] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.337834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.338063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.338236] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.338341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.338419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.338586] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.338687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.338780] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.645146] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.645331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.645486] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.646855] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f4db00a-f918-46f5-a9cd-748e3aaaae70 with status ACTIVE [ 1156.647060] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.647266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.647266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.647517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.647607] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.647714] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.647883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.647956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.648111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.648177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.648367] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.648476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.648541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.648936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.648936] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.648936] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f4db00a-f918-46f5-a9cd-748e3aaaae70 is going to be updated. [ 1156.674174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.674394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.674394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.674615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.674769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.674931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f4db00a-f918-46f5-a9cd-748e3aaaae70" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.843059] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.862349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1156.862578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.862734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.862957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.863175] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.863352] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.863458] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.863645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.863754] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.863870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.863981] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.940107] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1156.940411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.152071] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.344418] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.365874] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.654348] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.654595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.654595] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.654779] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.654881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.655024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be created. [ 1157.682091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.682243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.682308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.682518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.682682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.713302] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: UNINITIALIZED for 2s [ 1157.846845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.846966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.847065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.847260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.847397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.847541] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1157.869931] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a7ed067-ae07-49f5-b03a-aa95774538ec: rpc.has_security_group_logging(os_id): False [ 1157.879244] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.879244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.879244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.879447] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.879592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.892138] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.892349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.892410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.892686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.892805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.893064] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.893159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.893229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.893395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.893473] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.893562] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1157.895349] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1157.962542] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.962809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.962945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.963267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.963480] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.985893] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1159.724389] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1159.724928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.724928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.725089] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.725161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.725284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.725363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.725503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.725589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.725667] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.725775] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.905963] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1159.906245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.001545] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1160.002245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.228886] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.731686] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a61bfecd-4cd3-4e76-8516-854a7ee1f93b: rpc.has_security_group_logging(os_id): False [ 1160.758553] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.758689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.758795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.758969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.759129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.759322] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.759415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.759467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.759623] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.759699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.759774] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be created. [ 1160.829281] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.829281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.829281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.829281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.829281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.843318] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1161.338533] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.338533] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1162.573061] env[65973]: INFO networking_nsxv3.common.synchronization [req-6c5df514-acb7-4513-9dec-58c0aae7b0b4 req-50cdb4ec-15de-427d-88b2-f82089cb6d7a tempest-ServersNegativeTestJSON-1329693835 tempest-ServersNegativeTestJSON-1329693835-project-member] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1162.573655] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGHEST for action security_group_members [ 1162.573983] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.574135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.574216] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.574415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.574574] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.574677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.574736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.574879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.574964] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.575069] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.618367] env[65973]: INFO networking_nsxv3.common.synchronization [req-7e79d6ad-6d48-4f44-9586-112cccfbe9ac req-305d4b06-4a71-412a-9245-4d496be5e44a tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1162.618864] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGHEST for action security_group_members [ 1162.619202] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.619329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.619581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.619581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.619817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.619997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.620108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.620261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.620549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.620549] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.859593] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1162.859593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.979848] env[65973]: INFO networking_nsxv3.common.synchronization [req-7abb3ffe-9375-4687-8aff-3108743bf488 req-c9107c28-d6ad-4bf9-b45b-b8345cdb97e7 tempest-ServersTestJSON-912334766 tempest-ServersTestJSON-912334766-project-member] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1162.979848] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGHEST for action security_group_members [ 1162.980922] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.981151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.981232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.981864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.982122] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.982248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.982316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.982493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.982941] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.983129] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.077088] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.077317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.077366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.077571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.077664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.077888] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.077993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.078059] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.078214] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.078289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.078378] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be updated. [ 1163.106474] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.106561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.106634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.106874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.106965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.116715] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: IN_PROGRESS for 2s [ 1163.124030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.124030] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.124030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.124030] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 is going to be updated. [ 1163.150725] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.150725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.150725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.150962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.150962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.160629] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: IN_PROGRESS for 2s [ 1163.486059] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.486225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.486286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.486463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.486555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487332] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.487332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.487332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.487332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.487332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.487332] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be updated. [ 1163.515937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.516141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.516217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.516816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.516816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.528549] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: IN_PROGRESS for 2s [ 1165.127700] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 in Status: SUCCESS [ 1165.128070] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 deletion is rescheduled due to dependency. [ 1165.128070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.172051] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 in Status: SUCCESS [ 1165.172051] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 deletion is rescheduled due to dependency. [ 1165.172051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.538781] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7b78e3-6775-4a75-a625-09d47728d125 in Status: SUCCESS [ 1165.538996] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 deletion is rescheduled due to dependency. [ 1165.539147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.981867] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.981867] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.661021] env[65973]: INFO networking_nsxv3.common.synchronization [None req-e48913e5-6331-4bbc-961f-37f1d4ab7efd tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1170.661608] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1170.661974] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.662176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.662176] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.662425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.662506] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.738525] env[65973]: INFO networking_nsxv3.common.synchronization [None req-6a810d57-8bfc-4be6-a0b6-8f80189ffa56 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1170.739060] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1170.739375] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.739664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.185360] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.185554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.185554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.185778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.185864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.185954] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 already deleted. [ 1171.186052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.186210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.186376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.186455] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.708546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.708896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.708896] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.708966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.709081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.709184] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 already deleted. [ 1171.709264] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.838109] env[65973]: INFO networking_nsxv3.common.synchronization [req-89bbe9d4-c410-49fb-a997-8278caa34ca8 req-d309bcc7-bedc-4b4e-a524-2a9dea735613 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1173.838562] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1173.839164] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.839164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.839164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.839387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.839427] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.839516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.839577] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.839747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.839849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.839942] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.122035] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.122235] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.122360] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.122625] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.122972] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.123169] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.123300] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.123530] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.123680] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.123904] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.124035] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.124147] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.124249] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.124354] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.124456] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.124584] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.146919] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.147197] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1174.147496] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.147752] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.148183] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b2a3b211-b4d9-42ff-8060-19cce62925b1 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.148441] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.148578] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.148922] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.149076] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a3b211-b4d9-42ff-8060-19cce62925b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.342113] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.651603] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.651818] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.651949] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.652224] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.652372] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.652519] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b2a3b211-b4d9-42ff-8060-19cce62925b1 not found, creating... [ 1174.652832] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.652972] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.653063] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.653281] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.653414] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.653681] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.653829] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.653938] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.654162] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.654288] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.654421] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b2a3b211-b4d9-42ff-8060-19cce62925b1 is going to be created. [ 1174.673848] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.674090] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.674321] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.674567] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.674813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.675056] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.844762] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.347052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.347222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.347302] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.347610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.347670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.347759] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be updated. [ 1175.352602] env[65973]: INFO networking_nsxv3.common.synchronization [req-89bbe9d4-c410-49fb-a997-8278caa34ca8 req-835bdeb1-b5e7-4b42-8481-12cca592fb3b service nova] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1175.352771] env[65973]: INFO networking_nsxv3.common.synchronization [req-89bbe9d4-c410-49fb-a997-8278caa34ca8 req-835bdeb1-b5e7-4b42-8481-12cca592fb3b service nova] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1175.353052] env[65973]: INFO networking_nsxv3.common.synchronization [req-89bbe9d4-c410-49fb-a997-8278caa34ca8 req-835bdeb1-b5e7-4b42-8481-12cca592fb3b service nova] Enqueued Resource ID: b2a3b211-b4d9-42ff-8060-19cce62925b1 with Priority: HIGHEST for action port [ 1175.353578] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_rules [ 1175.353730] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1175.354098] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a3b211-b4d9-42ff-8060-19cce62925b1 with Priority: HIGHEST for action port [ 1175.354443] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.354565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.354634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.354824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.354904] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.355755] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.355847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.356098] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a3b211-b4d9-42ff-8060-19cce62925b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.356211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.356263] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.356961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.356961] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a3b211-b4d9-42ff-8060-19cce62925b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.376650] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.376856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.376856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.377177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.377329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.387050] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1175.858736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.859069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.859283] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2a3b211-b4d9-42ff-8060-19cce62925b1 with status ACTIVE [ 1175.859567] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.859732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.859812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.860092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.860168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.860330] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.860438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.860483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.860635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.860710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.860891] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.861046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.861094] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.861234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.861309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.861392] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2a3b211-b4d9-42ff-8060-19cce62925b1 is going to be updated. [ 1175.883531] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.883724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.883786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.884505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.884505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.884505] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a3b211-b4d9-42ff-8060-19cce62925b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.319518] env[65973]: INFO networking_nsxv3.common.synchronization [req-64ef5c5f-cea6-4459-aa5a-571713de2edc req-71b103f6-426a-4b6a-8fde-2b18414cecd1 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1176.322088] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1176.322088] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.322088] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.322088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.322088] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.670781] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.670979] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.671115] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.671467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.671790] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.672117] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.672329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.672671] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.672980] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.673251] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.673371] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.673482] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.673598] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.673723] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.673812] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.673941] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.694214] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.694387] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.694521] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.694696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-11" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.695027] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.695203] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.695320] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.695627] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.695763] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.825171] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.825559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.825559] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.825852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.825953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.826161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.826295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.826394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.826592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.826684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.826792] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 already deleted. [ 1176.826923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.198677] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.199127] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.199127] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.199345] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.199496] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.199650] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 not found, creating... [ 1177.200039] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.200216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.200335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.200566] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.200724] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.201043] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.201206] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.201322] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.201537] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.201666] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.201823] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 is going to be created. [ 1177.224016] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.224391] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.224584] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.224898] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.225218] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.225487] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.398086] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1177.398306] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.398502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.398763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.399010] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.399232] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.399308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.399507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.399597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.399711] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.901982] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.926019] env[65973]: INFO networking_nsxv3.common.synchronization [req-64ef5c5f-cea6-4459-aa5a-571713de2edc req-c939a1b9-7c12-4767-bd62-3f050aacc11c service nova] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1177.926777] env[65973]: INFO networking_nsxv3.common.synchronization [req-64ef5c5f-cea6-4459-aa5a-571713de2edc req-c939a1b9-7c12-4767-bd62-3f050aacc11c service nova] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1177.926777] env[65973]: INFO networking_nsxv3.common.synchronization [req-64ef5c5f-cea6-4459-aa5a-571713de2edc req-c939a1b9-7c12-4767-bd62-3f050aacc11c service nova] Enqueued Resource ID: 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 with Priority: HIGHEST for action port [ 1177.926777] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_rules [ 1177.926777] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1177.926777] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 with Priority: HIGHEST for action port [ 1177.927702] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.927916] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.928046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.928444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.928664] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.929606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.929777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.929915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.930162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.930674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.930859] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.930967] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.931184] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.931456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.931561] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.932514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.932677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.932773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.934819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.934819] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.404941] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.436440] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.437603] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.437740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.438096] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 with status ACTIVE [ 1178.438205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.438650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.438650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.438800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.438800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.438982] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.439092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.439155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.439375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.439444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.439593] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.439688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.439745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.439923] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.439991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.440554] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7 is going to be updated. [ 1178.462034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.462222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.462266] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.462435] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.462568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.462715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57fe5b94-3e12-4ee8-a7cb-bc5d7cdde8d7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.908067] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.908067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.908067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.908455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.908564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.908677] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be updated. [ 1178.935953] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.936164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.936164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.936382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.936526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.943151] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.945289] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1179.446493] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.446957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.446957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.446957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.447298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.447298] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 is going to be created. [ 1179.477508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.477734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.477734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.478027] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.478220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.489770] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: UNINITIALIZED for 2s [ 1180.957288] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1180.957680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.957943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.958215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.958505] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.958716] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.958783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.958970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.959096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.959217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.959343] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.461851] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.507630] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: SUCCESS [ 1181.507841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.508017] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.508252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.508451] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.508567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.508626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.508791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.508862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.508949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.509078] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.964138] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a61bfecd-4cd3-4e76-8516-854a7ee1f93b: rpc.has_security_group_logging(os_id): False [ 1181.984544] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.984833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.984833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.984940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.985037] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.985398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.985398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.985603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.985659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.985715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.985788] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be updated. [ 1182.011688] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.066951] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.067117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.067178] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.067399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.067554] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.083766] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1182.514420] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd6acc62-85f3-402a-8a15-8c40c08290a0: rpc.has_security_group_logging(os_id): False [ 1182.533156] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.533344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.533434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.533695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.533826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.534152] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.534279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.534372] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.534578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.534670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.534800] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 is going to be created. [ 1182.595313] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.595313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.595462] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.595545] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.597225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.608036] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: IN_PROGRESS for 2s [ 1182.927663] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.927663] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1183.378436] env[65973]: INFO networking_nsxv3.common.synchronization [None req-91cf798f-640d-4a2a-849c-f1fe8279cd7c tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1183.378899] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1183.379214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.379338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.379488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.379695] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.379854] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.379948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.380034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.380323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.380323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.380323] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.884570] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.884796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.884796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.885034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.885134] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.885335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.885437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.885499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.885658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.885734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.885819] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1183.915701] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.915701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.915701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.915701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.915701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.928291] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1184.100168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1184.100168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.621217] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: SUCCESS [ 1184.621536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.942494] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1185.943043] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea deletion is rescheduled due to dependency. [ 1185.943043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.379721] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1188.380174] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1193.381240] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.381240] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1195.288165] env[65973]: INFO networking_nsxv3.common.synchronization [req-f8fe28be-2cc4-4bb5-94d0-25da43f6f8c3 req-fc2d4efc-985e-4f32-8821-389d89e3019e tempest-ServersV294TestFqdnHostnames-665253038 tempest-ServersV294TestFqdnHostnames-665253038-project-member] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 1195.288860] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGHEST for action security_group_members [ 1195.289321] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.289432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.289432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.289937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.289937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.289937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.289937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.290224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.290224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.290285] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.796073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.796073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.796073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.796359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.818898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.819209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.819335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.819403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.819603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.819688] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.819778] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 is going to be updated. [ 1195.847475] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.847692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.847692] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.847903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.848070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.857489] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: IN_PROGRESS for 2s [ 1197.871306] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 in Status: SUCCESS [ 1197.871686] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 deletion is rescheduled due to dependency. [ 1197.871686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.185952] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.186332] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.186332] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.186543] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.186802] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.186979] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.187078] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.187297] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.187439] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.187638] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.187760] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.187865] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.187965] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.188082] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.188185] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.188310] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.209287] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.209473] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1200.209656] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.209865] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.210215] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-bef8265f-f3b6-465c-9b19-4fa5184601dc taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.210388] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.210517] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.210870] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.211035] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef8265f-f3b6-465c-9b19-4fa5184601dc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.289945] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.290157] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1200.713426] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.713722] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.713889] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.714216] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.717017] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port bef8265f-f3b6-465c-9b19-4fa5184601dc not found, creating... [ 1200.717017] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.717017] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.717017] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.717459] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.717459] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.717459] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: bef8265f-f3b6-465c-9b19-4fa5184601dc is going to be created. [ 1200.738712] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.738915] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.739055] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.739336] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.739564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.739783] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.480946] env[65973]: INFO networking_nsxv3.common.synchronization [req-4537a514-26bc-4632-8e03-7e09d2c9d303 req-bc6b323f-76a3-414e-8190-346367261737 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1201.480946] env[65973]: INFO networking_nsxv3.common.synchronization [req-4537a514-26bc-4632-8e03-7e09d2c9d303 req-bc6b323f-76a3-414e-8190-346367261737 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1201.480946] env[65973]: INFO networking_nsxv3.common.synchronization [req-4537a514-26bc-4632-8e03-7e09d2c9d303 req-bc6b323f-76a3-414e-8190-346367261737 service nova] Enqueued Resource ID: bef8265f-f3b6-465c-9b19-4fa5184601dc with Priority: HIGHEST for action port [ 1201.481629] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1201.482147] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1201.482147] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef8265f-f3b6-465c-9b19-4fa5184601dc with Priority: HIGHEST for action port [ 1201.482301] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.482441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.482441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.482616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.482723] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.484217] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.485011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.485011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.485349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.486028] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.486710] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef8265f-f3b6-465c-9b19-4fa5184601dc taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.486710] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.486819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.487588] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.487588] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef8265f-f3b6-465c-9b19-4fa5184601dc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.988598] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.988898] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.990078] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bef8265f-f3b6-465c-9b19-4fa5184601dc with status ACTIVE [ 1201.990285] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.990405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.990467] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.990675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.990753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.990937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.991057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.991132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.991322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.991322] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.991484] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.991574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.991621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.991758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.991833] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.991905] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bef8265f-f3b6-465c-9b19-4fa5184601dc is going to be updated. [ 1201.993171] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.017468] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.017629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.017705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.017909] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.018070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.018230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.496423] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.999256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.999503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.999503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.999718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.999811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.999909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1203.031238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.031443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.031443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.031570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.031712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.041474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1205.063362] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1205.063788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.063839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.064019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.064229] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.064346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.064410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.064570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.064651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.064735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.064825] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.567537] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.567733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.567778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.568012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.568179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.568276] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.568339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.568496] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.568582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.568671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.568820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.568911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.568972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.569135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.569302] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.569395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.569453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.569600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.569677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.569755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.569862] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.072561] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9b235ba-8426-4bfa-b2c5-84500087d8ea: rpc.has_security_group_logging(os_id): False [ 1206.083601] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.084333] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.084333] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.084482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.084863] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.085111] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.085287] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.085605] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.085823] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.086134] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.086299] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.086452] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.086619] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.086796] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.086974] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.087136] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.094397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.094619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.094619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.094786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.094879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.095081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.095193] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.095245] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.095399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.095470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.095667] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.095757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.095812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.095953] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.096041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.096224] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.096316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.096378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.096517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.096589] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.096674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1206.107500] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.107500] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1206.107660] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.107855] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-131" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.108153] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.108439] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.108564] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.108830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.108964] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0dc9d8-ebbc-4147-ab56-7605a00cc18d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.172967] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.173253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.173394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.173752] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.173996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.190108] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1206.483060] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.483301] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1206.611348] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.611642] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.611772] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.612253] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.612461] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.612773] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.612934] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.613183] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.613453] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.613603] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.613900] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.614068] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.614185] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.614402] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.614536] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.614675] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d is going to be updated. [ 1206.641637] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.641888] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.642153] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.642553] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.642785] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.643080] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.325738] env[65973]: INFO networking_nsxv3.common.synchronization [req-4a8f3492-25b8-41bd-96ea-15b6371b434f req-41ea429d-18b2-4e17-b0b4-8a3e922f2957 service nova] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1207.326076] env[65973]: INFO networking_nsxv3.common.synchronization [req-4a8f3492-25b8-41bd-96ea-15b6371b434f req-41ea429d-18b2-4e17-b0b4-8a3e922f2957 service nova] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1207.326076] env[65973]: INFO networking_nsxv3.common.synchronization [req-4a8f3492-25b8-41bd-96ea-15b6371b434f req-41ea429d-18b2-4e17-b0b4-8a3e922f2957 service nova] Enqueued Resource ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with Priority: HIGHEST for action port [ 1207.326605] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_rules [ 1207.326742] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1207.326841] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with Priority: HIGHEST for action port [ 1207.327370] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.327501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.327571] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.327775] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.327854] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.328736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.328831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.328894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.329095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.329274] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.329375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.329427] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.329580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.329662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.329747] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.330905] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.330997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.331070] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.331223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.331298] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0dc9d8-ebbc-4147-ab56-7605a00cc18d',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.832849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.833013] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.833291] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.836939] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba0dc9d8-ebbc-4147-ab56-7605a00cc18d with status ACTIVE [ 1207.836939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.836939] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.836939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.837599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.837599] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.837599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.837599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.837819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.837928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.838102] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba0dc9d8-ebbc-4147-ab56-7605a00cc18d is going to be updated. [ 1207.860864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.861053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.861108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.861323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.861477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.861645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0dc9d8-ebbc-4147-ab56-7605a00cc18d" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.205061] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1208.205283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.340713] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.843847] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.844168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.844168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.844399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.844517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.844580] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be updated. [ 1208.874017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.874212] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.874254] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.874455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.874605] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.884153] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: IN_PROGRESS for 2s [ 1210.895193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: SUCCESS [ 1210.895570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.895652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.895942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.896215] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.896288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.896366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.896567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.896665] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.896772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.896873] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.398853] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.901750] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1988574b-e8ea-411d-ac4f-bf196438bafb: rpc.has_security_group_logging(os_id): False [ 1211.919946] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.920222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.920222] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.920408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.920536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.920783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.920850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.920914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.921087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.921196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.921287] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be updated. [ 1211.996674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.996945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.996945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.997202] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.997414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.013233] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: IN_PROGRESS for 2s [ 1212.327567] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.327567] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1214.031147] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: SUCCESS [ 1214.031601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.328688] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.329073] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1217.779251] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.779711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.779711] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.780286] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.780657] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.781035] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.781241] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.781761] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.782211] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.782705] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.782882] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.783066] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.783212] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.783319] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.783479] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.783756] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.813081] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.813549] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.813822] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.814061] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-227" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.814399] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-bef8265f-f3b6-465c-9b19-4fa5184601dc taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.814905] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.815152] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.816759] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.816759] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef8265f-f3b6-465c-9b19-4fa5184601dc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.318949] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.319280] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.319420] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.319696] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.319848] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.320189] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.320375] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.320458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.320708] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.320946] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.321153] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.321307] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.321420] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.321928] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.321928] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.321928] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: bef8265f-f3b6-465c-9b19-4fa5184601dc is going to be updated. [ 1218.344256] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.344652] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.344652] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.344965] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.345247] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.345538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.014950] env[65973]: INFO networking_nsxv3.common.synchronization [req-d361c6b4-b98e-4686-91f1-b3670ea89bde req-aca2ed29-e8b5-4758-92b3-16adedd5e609 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1219.015091] env[65973]: INFO networking_nsxv3.common.synchronization [req-d361c6b4-b98e-4686-91f1-b3670ea89bde req-aca2ed29-e8b5-4758-92b3-16adedd5e609 service nova] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1219.015235] env[65973]: INFO networking_nsxv3.common.synchronization [req-d361c6b4-b98e-4686-91f1-b3670ea89bde req-aca2ed29-e8b5-4758-92b3-16adedd5e609 service nova] Enqueued Resource ID: bef8265f-f3b6-465c-9b19-4fa5184601dc with Priority: HIGHEST for action port [ 1219.015464] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_rules [ 1219.015592] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1219.015684] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef8265f-f3b6-465c-9b19-4fa5184601dc with Priority: HIGHEST for action port [ 1219.016564] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.016742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.016778] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.016972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.017065] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.017893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.018012] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.018084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.018251] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.018625] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.018731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.018798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.018949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.019058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.019149] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.019947] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef8265f-f3b6-465c-9b19-4fa5184601dc taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.019947] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.020106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.020168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.020246] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef8265f-f3b6-465c-9b19-4fa5184601dc',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.521968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.522421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.522421] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.523354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bef8265f-f3b6-465c-9b19-4fa5184601dc with status ACTIVE [ 1219.523541] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.523655] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.523736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.523956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.524046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.524335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.524335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.524508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.524552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.524664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.524816] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.524938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.525019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.525166] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.525247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.525314] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bef8265f-f3b6-465c-9b19-4fa5184601dc is going to be updated. [ 1219.549893] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.550137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.550249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.550515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.550699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.550892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef8265f-f3b6-465c-9b19-4fa5184601dc" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.027458] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.293270] env[65973]: INFO networking_nsxv3.common.synchronization [req-7cc538c6-9585-45be-9727-0f6c77a78ab5 req-899ba7a6-b66c-43cd-a8ba-bdaefc6bc2a4 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1220.293934] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1220.294268] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.294391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.294459] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.294657] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.294809] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.294927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.294995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.295171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.295252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.295346] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.529706] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.530144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.530144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.530343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.530441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.530550] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1220.559880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.560108] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.560159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.560331] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.560475] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.571842] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1220.798039] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.300564] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.803457] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.803781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.803781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.803917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.804014] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.804132] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1221.833289] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.833471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.833471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.833694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.833841] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.844010] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1222.582224] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1222.582468] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.582696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.582917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.583129] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.583269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.583344] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.583511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.583593] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.583681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.583774] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.085602] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.085891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.085891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.086076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.086270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.086346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.086410] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.086549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.086637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.086727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.086875] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.086966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.087035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.087177] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.087312] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.087399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.087455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.087591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.087666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.087745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.087829] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.591430] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9b235ba-8426-4bfa-b2c5-84500087d8ea: rpc.has_security_group_logging(os_id): False [ 1223.610682] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.610682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.610682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.610682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.610682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.610682] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.611045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.611045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.611045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.611045] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.611265] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.611394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.611429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.611637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.611723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.611884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.611986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.612076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.612567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.612567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.612567] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1223.688507] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.688507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.688507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.688720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.688751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.718015] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1223.857354] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1223.857354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.884381] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.884381] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.884381] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.885151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.886019] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.886405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.886722] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.887353] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.887838] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.888071] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1223.888330] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1223.888918] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1223.889535] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1223.889535] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1223.889804] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1223.891083] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1223.910409] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1223.911188] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1223.913089] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1223.913089] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-428" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.913089] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-8d408943-5a9d-43d2-9ed3-5d0e86343b58 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.913089] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.913089] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.913089] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.913089] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d408943-5a9d-43d2-9ed3-5d0e86343b58',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.921020] env[65973]: INFO networking_nsxv3.common.synchronization [None req-22f6f256-a953-4cff-a35e-683a44cc618f tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1223.921020] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1223.921020] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.921020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.921020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.921020] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.921020] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.006578] env[65973]: INFO networking_nsxv3.common.synchronization [None req-c38fc898-0438-4693-be14-6766174c459b tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1224.007272] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1224.007392] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.007495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.415972] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.416486] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.416486] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.416714] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.416865] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.417219] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.417405] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.417538] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.417773] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.417908] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.418230] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.418401] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.418513] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.418772] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.418902] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.419052] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 is going to be updated. [ 1224.446923] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.447205] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.447301] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.447622] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.447840] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.448104] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.454027] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.454510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.454510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.454510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.454637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.454637] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 already deleted. [ 1224.454722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.454880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.455060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.455164] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.979817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.979944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.980095] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.980288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.980380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.980481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 already deleted. [ 1224.980564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.180367] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f25ca7c-c887-48fd-8cbd-4439ce426854 req-9e6b8a05-2422-4b2b-81d4-ea9befc437f7 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1225.180703] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f25ca7c-c887-48fd-8cbd-4439ce426854 req-9e6b8a05-2422-4b2b-81d4-ea9befc437f7 service nova] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1225.180703] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f25ca7c-c887-48fd-8cbd-4439ce426854 req-9e6b8a05-2422-4b2b-81d4-ea9befc437f7 service nova] Enqueued Resource ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with Priority: HIGHEST for action port [ 1225.181222] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_rules [ 1225.181361] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1225.181458] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with Priority: HIGHEST for action port [ 1225.181737] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.181860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.181929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.182293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.182442] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.183766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.184542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.184650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.187938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.187938] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.187938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d408943-5a9d-43d2-9ed3-5d0e86343b58 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.187938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.187938] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d408943-5a9d-43d2-9ed3-5d0e86343b58',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.689364] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.689682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.689800] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.690955] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d408943-5a9d-43d2-9ed3-5d0e86343b58 with status ACTIVE [ 1225.691216] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.691373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.691469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.691731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.691852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.692123] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.692267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.692353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.692564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.692672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.692922] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.693062] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.693148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.693335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.693457] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.693543] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d408943-5a9d-43d2-9ed3-5d0e86343b58 is going to be updated. [ 1225.723011] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.723011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.723011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.723011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.723011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.723011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d408943-5a9d-43d2-9ed3-5d0e86343b58" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.733040] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1225.733040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.196075] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.699087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.699087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.699087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.699087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.699606] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.699606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1226.729678] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.729913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.729913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.730135] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.730359] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.741024] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1228.752514] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1228.752870] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.752968] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.753218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.753410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.753562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.753630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.753787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.753867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.753951] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.754052] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.256154] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.758124] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a7ed067-ae07-49f5-b03a-aa95774538ec: rpc.has_security_group_logging(os_id): False [ 1229.776952] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.777173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.777173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.777397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.777490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.777736] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.777837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.777900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.778071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.778151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.778240] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1229.833765] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.833980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.833980] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.834142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.834307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.854145] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1230.183074] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.183074] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1230.729115] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6fac639-c4da-4e5e-9fbd-44dd80c6e30e req-beea51ab-52ba-486e-999b-7a3855cba335 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1230.729825] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1230.730263] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.730389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.730470] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.730748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.730990] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.731123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.731182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.731449] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.731539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.731648] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.044188] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.044188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.044188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.044188] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.044188] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.044830] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.045018] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.045411] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.045784] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.046102] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.046307] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1231.046507] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1231.046685] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1231.046858] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.046998] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1231.047177] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1231.066908] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1231.067097] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1231.067259] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1231.067464] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.067823] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-40416c63-de9b-405d-89eb-b089b4f5c066 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.068055] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.068236] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.068590] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.068760] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40416c63-de9b-405d-89eb-b089b4f5c066',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.233938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.234197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.234271] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.234547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.234598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.234806] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.234904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.234966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.235131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.235209] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.235295] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 already deleted. [ 1231.235384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.571356] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.571662] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.571788] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.572070] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.572267] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.572428] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 40416c63-de9b-405d-89eb-b089b4f5c066 not found, creating... [ 1231.572751] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.572914] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.573048] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.573339] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.573528] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.573880] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.574034] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.574097] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.574342] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.574477] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.574642] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 40416c63-de9b-405d-89eb-b089b4f5c066 is going to be created. [ 1231.596343] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.596720] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.596720] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.597021] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.597241] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.597467] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.874139] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1231.874399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.326666] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6fac639-c4da-4e5e-9fbd-44dd80c6e30e req-9f1932a8-c3cb-41ba-8b9e-6974bc2b475b service nova] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1232.326984] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6fac639-c4da-4e5e-9fbd-44dd80c6e30e req-9f1932a8-c3cb-41ba-8b9e-6974bc2b475b service nova] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1232.327113] env[65973]: INFO networking_nsxv3.common.synchronization [req-b6fac639-c4da-4e5e-9fbd-44dd80c6e30e req-9f1932a8-c3cb-41ba-8b9e-6974bc2b475b service nova] Enqueued Resource ID: 40416c63-de9b-405d-89eb-b089b4f5c066 with Priority: HIGHEST for action port [ 1232.327782] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_rules [ 1232.327971] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1232.328261] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40416c63-de9b-405d-89eb-b089b4f5c066 with Priority: HIGHEST for action port [ 1232.328581] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.328736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.328806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.329106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.329194] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.330658] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.330965] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.331060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.331320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.331497] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.331601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.331659] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.331812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.331900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.332274] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.333342] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-40416c63-de9b-405d-89eb-b089b4f5c066 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.333508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.334444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.334444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.334444] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40416c63-de9b-405d-89eb-b089b4f5c066',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.831636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.831860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.834234] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.837055] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40416c63-de9b-405d-89eb-b089b4f5c066 with status ACTIVE [ 1232.837262] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.837436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.837541] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.837756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.837862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.838070] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.838175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.838236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.838401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.838481] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.838660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.839068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.839068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.839068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.839068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.839221] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40416c63-de9b-405d-89eb-b089b4f5c066 is going to be updated. [ 1232.867042] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.867042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.867042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.867042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.867042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.867042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40416c63-de9b-405d-89eb-b089b4f5c066" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.336554] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.840820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.840977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.841061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.841284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.841378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.841481] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 is going to be created. [ 1233.868142] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.868313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.868354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.868784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.868784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.878734] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: UNINITIALIZED for 2s [ 1235.258297] env[65973]: INFO networking_nsxv3.common.synchronization [req-e0c17d8c-aad1-4f27-bbb7-8d439252c21c req-161311e8-0e57-4451-84cd-a43a6e0351a1 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1235.259084] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1235.259269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.259421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.259489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.259736] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.259917] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.260049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.260146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.260360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.260474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.260589] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.763129] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.892731] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: SUCCESS [ 1235.892933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.893109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.893363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.893587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.893709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.893772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.893939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.894035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.894109] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.894202] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.265971] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.396692] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.768932] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.769140] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.769320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.769527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.769639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.769848] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be updated. [ 1236.805126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.805370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.805508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.805747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.805904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.819071] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1236.898805] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b055eda4-1eeb-41de-ba8a-7910ea006a83: rpc.has_security_group_logging(os_id): False [ 1236.919874] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.920034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.920124] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.920422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.920529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.920790] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.920913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.920966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.921114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.921186] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.921295] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 is going to be created. [ 1236.990971] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.991295] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.991378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.991677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.991948] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.006206] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: IN_PROGRESS for 2s [ 1237.668149] env[65973]: INFO networking_nsxv3.common.synchronization [req-22ac7ee1-d37d-4075-bdee-a319e9fc2d97 req-12aea1e6-d34c-44c0-9093-82fc5cae9e84 tempest-ServerActionsTestOtherA-1181206916 tempest-ServerActionsTestOtherA-1181206916-project-member] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1237.669097] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGHEST for action security_group_members [ 1237.669427] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.669561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.669645] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.669850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.670024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.670148] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.670247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.670432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.670529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.670640] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.173652] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.173728] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.173761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.174130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.174130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.174310] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.174442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.174529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.174719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.174802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.174893] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be updated. [ 1238.200718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.200911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.200911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.201146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.201285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.209385] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: IN_PROGRESS for 2s [ 1238.832305] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1238.832714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.018255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: SUCCESS [ 1239.018486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.219517] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8da0d868-de85-4818-aa51-4d52389cba32 in Status: SUCCESS [ 1240.219885] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 deletion is rescheduled due to dependency. [ 1240.219885] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.670857] env[65973]: INFO networking_nsxv3.common.synchronization [req-ab6efeca-e554-4c86-9762-e4376b6c42e6 req-3a1b2962-69ac-4b69-884b-22b2d5449a3c tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1241.671513] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGHEST for action security_group_members [ 1241.671607] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.671676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.671719] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.671908] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.672321] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.672321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.672321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.672686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.672686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.672686] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.175310] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.175497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.175619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.175961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.176162] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.176565] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.176745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.176858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.177414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.177414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.177540] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be updated. [ 1242.207084] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.207269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.207269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.207929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.207929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.217169] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: IN_PROGRESS for 2s [ 1243.018235] env[65973]: INFO networking_nsxv3.common.synchronization [req-12de45a3-8656-4b04-b579-859609b1d5df req-15817424-6e4c-47fd-98b9-210e20a46c04 tempest-AttachVolumeNegativeTest-1394627945 tempest-AttachVolumeNegativeTest-1394627945-project-member] Enqueued Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1243.019194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 with Priority: HIGHEST for action security_group_members [ 1243.019936] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd6acc62-85f3-402a-8a15-8c40c08290a0 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.020243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.021039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.021039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.021039] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.021039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.021039] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.021566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.021753] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.021937] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd6acc62-85f3-402a-8a15-8c40c08290a0',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.525118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.525444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.525444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.525680] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.525773] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.525975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.526674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.526674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.526674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.526674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.526674] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 is going to be updated. [ 1243.555609] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.555830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.555830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.556015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.556160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.565703] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: IN_PROGRESS for 2s [ 1243.739394] env[65973]: INFO networking_nsxv3.common.synchronization [req-26ca7a53-81ba-4c59-b342-f2798a706dc6 req-24a6848e-4865-4c92-8921-b8f9f9273760 tempest-ServerActionsTestOtherB-2088073309 tempest-ServerActionsTestOtherB-2088073309-project-member] Enqueued Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1243.739394] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec with Priority: HIGHEST for action security_group_members [ 1243.739394] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a7ed067-ae07-49f5-b03a-aa95774538ec taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.740015] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.740142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.740408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.740610] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.740769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.740826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.741048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.741157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.741261] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a7ed067-ae07-49f5-b03a-aa95774538ec',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.228391] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b in Status: SUCCESS [ 1244.228666] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b deletion is rescheduled due to dependency. [ 1244.228831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.246485] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.246642] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.246721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.246938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.247040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.247237] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.247338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.247400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.247552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.247626] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.247710] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec is going to be updated. [ 1244.275087] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.275281] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.275318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.275523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.275669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.285477] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: IN_PROGRESS for 2s [ 1245.309865] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9e0fed53-dfdc-4c7f-af3a-83ee23cd4e23 tempest-AttachInterfacesTestJSON-1450649219 tempest-AttachInterfacesTestJSON-1450649219-project-member] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1245.310932] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGHEST for action security_group_members [ 1245.311103] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.311236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.311304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.311504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.314993] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.314993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.314993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.314993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.314993] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.314993] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.575656] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 in Status: SUCCESS [ 1245.575908] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd6acc62-85f3-402a-8a15-8c40c08290a0 deletion is rescheduled due to dependency. [ 1245.575991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd6acc62-85f3-402a-8a15-8c40c08290a0" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.816933] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.816933] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.816933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.816933] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be updated. [ 1245.851203] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.851368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.851408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.851703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.851856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.860612] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: IN_PROGRESS for 2s [ 1246.298209] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec in Status: SUCCESS [ 1246.298498] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a7ed067-ae07-49f5-b03a-aa95774538ec deletion is rescheduled due to dependency. [ 1246.299126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a7ed067-ae07-49f5-b03a-aa95774538ec" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.615431] env[65973]: INFO networking_nsxv3.common.synchronization [None req-9f5b0247-4ffb-4f87-9ff8-66cb02644de3 None None] Enqueued Resource ID: 19a86119-86bb-4d40-8b0a-8729665b4e03 with Priority: HIGHEST for action port [ 1246.615956] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a86119-86bb-4d40-8b0a-8729665b4e03 with Priority: HIGHEST for action port [ 1246.616278] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-19a86119-86bb-4d40-8b0a-8729665b4e03 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.616430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19a86119-86bb-4d40-8b0a-8729665b4e03" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.616472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19a86119-86bb-4d40-8b0a-8729665b4e03" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.616722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19a86119-86bb-4d40-8b0a-8729665b4e03" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.616804] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19a86119-86bb-4d40-8b0a-8729665b4e03',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.118831] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19a86119-86bb-4d40-8b0a-8729665b4e03 [ 1247.118831] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.118831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.118831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.119088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.119175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.119293] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19a86119-86bb-4d40-8b0a-8729665b4e03 already deleted. [ 1247.119329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19a86119-86bb-4d40-8b0a-8729665b4e03" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.482127] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.482363] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:3 started [ 1247.870908] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea in Status: SUCCESS [ 1247.871224] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea deletion is rescheduled due to dependency. [ 1247.871224] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.158215] env[65973]: INFO networking_nsxv3.common.synchronization [None req-8edb0efd-a413-4298-985c-2feec24308d6 None None] Enqueued Resource ID: b01e6be1-0982-4a18-80c7-330ade1c4026 with Priority: HIGHEST for action port [ 1249.158755] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b01e6be1-0982-4a18-80c7-330ade1c4026 with Priority: HIGHEST for action port [ 1249.159073] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b01e6be1-0982-4a18-80c7-330ade1c4026 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.159200] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b01e6be1-0982-4a18-80c7-330ade1c4026" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.159269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b01e6be1-0982-4a18-80c7-330ade1c4026" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.159526] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b01e6be1-0982-4a18-80c7-330ade1c4026" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.159615] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b01e6be1-0982-4a18-80c7-330ade1c4026',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.663092] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b01e6be1-0982-4a18-80c7-330ade1c4026 [ 1249.663092] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.663092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.663092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.663092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.663092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.663092] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b01e6be1-0982-4a18-80c7-330ade1c4026 already deleted. [ 1249.663092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b01e6be1-0982-4a18-80c7-330ade1c4026" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.998395] env[65973]: INFO networking_nsxv3.common.synchronization [None req-492e34b9-88dc-4789-afd7-edd8cceb52b2 None None] Enqueued Resource ID: 7fc5002d-8a65-4a22-85d2-3e7f4b1204d2 with Priority: HIGHEST for action port [ 1249.998528] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc5002d-8a65-4a22-85d2-3e7f4b1204d2 with Priority: HIGHEST for action port [ 1249.999112] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fc5002d-8a65-4a22-85d2-3e7f4b1204d2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.999403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fc5002d-8a65-4a22-85d2-3e7f4b1204d2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.999403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fc5002d-8a65-4a22-85d2-3e7f4b1204d2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.999551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fc5002d-8a65-4a22-85d2-3e7f4b1204d2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.999629] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fc5002d-8a65-4a22-85d2-3e7f4b1204d2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.501131] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fc5002d-8a65-4a22-85d2-3e7f4b1204d2 [ 1250.501938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.501938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.501938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.501938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.501938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.502280] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fc5002d-8a65-4a22-85d2-3e7f4b1204d2 already deleted. [ 1250.502280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fc5002d-8a65-4a22-85d2-3e7f4b1204d2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.885434] env[65973]: INFO networking_nsxv3.common.synchronization [req-77fbbfb1-a3ca-4715-a832-e7b05e46c238 req-a783ea85-7152-40e2-a3c5-c59a1ca6a600 tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1251.885962] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1251.886277] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.886402] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.886460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.886714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.886862] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.886960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.887032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.887182] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.887267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.887412] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.178808] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.179036] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.179140] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.179465] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.179724] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.179877] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.179989] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.182224] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.182910] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.182910] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.182910] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.182910] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.183109] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.183109] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.183174] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.183302] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.204447] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.205204] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1252.205204] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.205204] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-16" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.205356] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-b40df3b5-39f7-4708-b82e-fdf4adec1e99 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.205435] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.205624] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.205996] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.206429] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40df3b5-39f7-4708-b82e-fdf4adec1e99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.274860] env[65973]: INFO networking_nsxv3.common.synchronization [None req-3c246c5f-25c2-4a4e-82b1-ecd0773462ab None None] Enqueued Resource ID: 0775c436-7b5d-4a66-9dd9-950de2723553 with Priority: HIGHEST for action port [ 1252.275475] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0775c436-7b5d-4a66-9dd9-950de2723553 with Priority: HIGHEST for action port [ 1252.275845] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-0775c436-7b5d-4a66-9dd9-950de2723553 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.275989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0775c436-7b5d-4a66-9dd9-950de2723553" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.276351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0775c436-7b5d-4a66-9dd9-950de2723553" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.276534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0775c436-7b5d-4a66-9dd9-950de2723553" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.276655] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0775c436-7b5d-4a66-9dd9-950de2723553',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.389307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.389544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.389544] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.389694] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.389786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.389978] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.390088] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.390151] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.390299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.390378] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.390456] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 already deleted. [ 1252.390537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.709117] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.709413] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.709519] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.709806] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.709956] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.710137] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port b40df3b5-39f7-4708-b82e-fdf4adec1e99 not found, creating... [ 1252.710499] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.710695] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.710787] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.711014] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.711158] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.711441] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.711597] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.711713] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.712010] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.712172] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.712405] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 is going to be created. [ 1252.733920] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.734151] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.734274] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.734550] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.734779] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.735038] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.778538] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0775c436-7b5d-4a66-9dd9-950de2723553 [ 1252.778783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.778917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.778988] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.779237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.779332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.779429] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0775c436-7b5d-4a66-9dd9-950de2723553 already deleted. [ 1252.779511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0775c436-7b5d-4a66-9dd9-950de2723553" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.482552] env[65973]: INFO networking_nsxv3.common.synchronization [req-77fbbfb1-a3ca-4715-a832-e7b05e46c238 req-217d7ccb-b69d-4815-b76b-a551f07cbb33 service nova] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1253.482867] env[65973]: INFO networking_nsxv3.common.synchronization [req-77fbbfb1-a3ca-4715-a832-e7b05e46c238 req-217d7ccb-b69d-4815-b76b-a551f07cbb33 service nova] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1253.483027] env[65973]: INFO networking_nsxv3.common.synchronization [req-77fbbfb1-a3ca-4715-a832-e7b05e46c238 req-217d7ccb-b69d-4815-b76b-a551f07cbb33 service nova] Enqueued Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1253.483503] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1253.483984] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1253.484208] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1253.484530] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.484696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.484809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.485127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.485224] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.488104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.488104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.488104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.488104] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.488104] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40df3b5-39f7-4708-b82e-fdf4adec1e99 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.488648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.488648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.488648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.488648] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40df3b5-39f7-4708-b82e-fdf4adec1e99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.990981] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.991987] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.992631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.992631] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b40df3b5-39f7-4708-b82e-fdf4adec1e99 with status ACTIVE [ 1253.992631] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.992631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.992631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.993096] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.993156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.993310] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.994040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.994312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.994312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.994312] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 is going to be updated. [ 1254.014710] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.014871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.014914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.015142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.015280] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.015437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.496104] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.726212] env[65973]: INFO networking_nsxv3.common.synchronization [req-9ca99efe-4c4a-4ec0-854f-bd811338e1f6 req-edfc5421-a972-4aac-a90a-b3d1e09327cc tempest-AttachVolumeShelveTestJSON-2080050408 tempest-AttachVolumeShelveTestJSON-2080050408-project-member] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1254.726792] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGHEST for action security_group_members [ 1254.727270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.727419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.727479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.727765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.727925] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.728035] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.728091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.728255] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.728787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.728787] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.002500] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.002729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.002729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.002945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.003046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.003255] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be created. [ 1255.027181] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.027383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.027383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.027629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.027796] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.036950] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: UNINITIALIZED for 2s [ 1255.231286] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.231286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.231286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.231578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.231633] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.231836] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.231939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.232019] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.232167] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.232244] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.232332] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be updated. [ 1255.262146] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.262396] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.262451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.262691] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.262881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.272257] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: IN_PROGRESS for 2s [ 1255.660636] env[65973]: INFO networking_nsxv3.common.synchronization [req-01e97594-fbc2-42e9-bc5c-0417b099ddc5 req-905d27d0-ca38-4ff0-9e8e-edf91ce557d7 tempest-InstanceActionsV221TestJSON-1203996889 tempest-InstanceActionsV221TestJSON-1203996889-project-member] Enqueued Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1255.661283] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1255.661641] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.661749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.661799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.662053] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.662204] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.662304] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.662405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.662581] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.662678] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.662799] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.957630] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.957832] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-838" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.957832] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-838" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.958633] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-838" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.958792] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.958952] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.959088] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.959315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.959458] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.959659] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.959766] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.959869] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.959971] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.960085] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.960192] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.960350] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.980036] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.980274] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.980401] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.980542] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-838" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.980853] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.981032] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.981150] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.981472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.981608] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.164619] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.164776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.164820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.165054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.165149] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.165339] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.165436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.165517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.165673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.165751] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.165836] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db already deleted. [ 1256.165915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.484615] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.484826] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.484951] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.485359] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.485515] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.485664] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f not found, creating... [ 1256.485919] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.486083] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.486199] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.486419] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.486552] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.486825] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.487022] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.487160] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.487352] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.487621] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.487693] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f is going to be created. [ 1256.509529] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.509729] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.509782] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.510067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.510293] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.510502] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.045975] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1257.046229] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.046371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.046937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.046937] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.046937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.046937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.047397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.047397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.047397] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.047397] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.240680] env[65973]: INFO networking_nsxv3.common.synchronization [req-01e97594-fbc2-42e9-bc5c-0417b099ddc5 req-32d25312-6d31-4ee3-a7d9-22b8b50fcaaf service nova] Enqueued Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_rules [ 1257.240861] env[65973]: INFO networking_nsxv3.common.synchronization [req-01e97594-fbc2-42e9-bc5c-0417b099ddc5 req-32d25312-6d31-4ee3-a7d9-22b8b50fcaaf service nova] Enqueued Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1257.240994] env[65973]: INFO networking_nsxv3.common.synchronization [req-01e97594-fbc2-42e9-bc5c-0417b099ddc5 req-32d25312-6d31-4ee3-a7d9-22b8b50fcaaf service nova] Enqueued Resource ID: e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f with Priority: HIGHEST for action port [ 1257.243320] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_rules [ 1257.243482] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1257.243667] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f with Priority: HIGHEST for action port [ 1257.243896] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.244025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.244217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.244380] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.244484] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.245355] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.245495] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.245572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.245827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.245884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.245979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.246127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.246205] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.246293] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.246386] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.247222] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.247336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.247399] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.247534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.247607] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.283128] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1988574b-e8ea-411d-ac4f-bf196438bafb in Status: SUCCESS [ 1257.283318] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb deletion is rescheduled due to dependency. [ 1257.283376] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.550372] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.550562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.550562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.550931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.551157] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.551278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.551361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.551629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.551812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.552000] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.552252] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.552446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.552562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.552737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.552881] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.552975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.553049] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.553197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.553325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.553387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.553447] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.748861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.748992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.751400] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f with status ACTIVE [ 1257.751587] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.751708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.751772] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.751985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.752086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.752257] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.752421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.752572] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.752800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.752897] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.753118] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.753387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.753387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.753519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.753612] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.753725] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f is going to be updated. [ 1257.755176] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.777379] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.777530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.777575] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.777820] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.777957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.778130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2a5a0e9-e1d8-4605-acc9-a2a76f9df39f" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.055168] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3: rpc.has_security_group_logging(os_id): False [ 1258.073861] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.074083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.074083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.074242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.074328] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.074534] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.074618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.074673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.074831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.074904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.075091] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.075187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.075249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.075389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.075465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.075655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.075765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.075838] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.075984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.076069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.076152] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be created. [ 1258.174354] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.174975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.175069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.175283] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.175463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.187672] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1258.258371] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.760584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.760584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.760584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.760860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.760893] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.760985] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db is going to be created. [ 1258.786342] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.786491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.786539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.786720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.786877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.797827] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: UNINITIALIZED for 2s [ 1260.201598] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1260.201837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.809153] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: SUCCESS [ 1260.809335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.809463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.809686] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.809881] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.809998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.810075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.810236] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.810333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.810440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.810538] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.313459] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.314090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.314090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.314090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.314090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.314355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.314355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.314465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.314465] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.314549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.314713] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.314806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.314881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.315032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.315205] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.315309] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.315383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.315533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.315610] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.315726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.315893] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.818546] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33728b10-62d7-4dd6-b006-045dd7d855db: rpc.has_security_group_logging(os_id): False [ 1261.837070] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.837260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.837260] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.837456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.837543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.837735] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.837834] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.837945] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.838067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.838146] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.838344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.838438] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.838499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.838641] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.838734] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.838983] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.839125] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.839183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.839303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.839386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.839467] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db is going to be created. [ 1261.897400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.897639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.897639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.897800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.897983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.908511] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: IN_PROGRESS for 2s [ 1262.245490] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.245684] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1263.923959] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: SUCCESS [ 1263.924395] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.246994] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.247477] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1268.446351] env[65973]: INFO networking_nsxv3.common.synchronization [req-2c19f358-372b-40a1-bc85-28d6c575ea43 req-95130675-13cc-43cc-8c16-89efb81e1237 tempest-InstanceActionsV221TestJSON-1203996889 tempest-InstanceActionsV221TestJSON-1203996889-project-member] Enqueued Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1268.447211] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGHEST for action security_group_members [ 1268.447211] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.447370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.447370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.447721] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.447784] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.447879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.447943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.448119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.448225] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.448307] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.950638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.950871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.950871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.951041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.951277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.951368] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.951430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.951479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.951636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.951714] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.951803] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db is going to be updated. [ 1268.993508] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.993783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.993783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.993877] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.994040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.004235] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: IN_PROGRESS for 2s [ 1269.877676] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1269.878025] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1269.878607] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1269.878803] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1269.879183] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.879242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.879297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.879557] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.879712] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.879810] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.879873] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.880034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.880121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.880215] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.881474] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.881565] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.881639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.881801] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.881943] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.882051] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.882117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.882262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.882346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.882503] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.923438] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1269.923634] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1269.923864] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_rules [ 1269.924017] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1269.924149] env[65973]: INFO networking_nsxv3.common.synchronization [req-79ee34cd-acc4-477d-9335-07fea10357ca req-5e8a85f2-3c7b-467a-ba7f-2816d8aed45d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1269.924656] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1269.924799] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_rules [ 1269.924890] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1269.924981] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1269.925092] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1269.925632] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.925769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.925894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.926018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.926135] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.927101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.927220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.927287] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.927515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.927593] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.928563] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40df3b5-39f7-4708-b82e-fdf4adec1e99 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.928674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.928740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.928894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.928968] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40df3b5-39f7-4708-b82e-fdf4adec1e99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.929655] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.929748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.929971] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.930025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.183346] env[65973]: INFO networking_nsxv3.common.synchronization [req-44579f14-ba98-4fd1-a9d6-fe6a8ddeb06a req-e90442e1-36bd-4e22-8bcd-04158209151a tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1270.183346] env[65973]: INFO networking_nsxv3.common.synchronization [req-44579f14-ba98-4fd1-a9d6-fe6a8ddeb06a req-e90442e1-36bd-4e22-8bcd-04158209151a tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1270.184185] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd with Priority: HIGHEST for action security_group_members [ 1270.184185] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1270.184880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.184880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.184880] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.184880] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.225687] env[65973]: INFO networking_nsxv3.common.synchronization [req-44579f14-ba98-4fd1-a9d6-fe6a8ddeb06a req-e90442e1-36bd-4e22-8bcd-04158209151a tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1270.225856] env[65973]: INFO networking_nsxv3.common.synchronization [req-44579f14-ba98-4fd1-a9d6-fe6a8ddeb06a req-e90442e1-36bd-4e22-8bcd-04158209151a tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1270.225987] env[65973]: INFO networking_nsxv3.common.synchronization [req-44579f14-ba98-4fd1-a9d6-fe6a8ddeb06a req-e90442e1-36bd-4e22-8bcd-04158209151a tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1270.226480] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_rules [ 1270.226616] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1270.226709] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 with Priority: HIGHEST for action port [ 1270.226982] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.227087] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.227283] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.227363] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.227542] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40df3b5-39f7-4708-b82e-fdf4adec1e99 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.227843] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.383761] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.386291] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.431384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.432100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.432363] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b40df3b5-39f7-4708-b82e-fdf4adec1e99 with status ACTIVE [ 1270.432657] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.432815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.432913] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.433247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.433444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.433633] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.433784] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.433881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.434156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.434278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.434562] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.435071] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.435142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.435370] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.435487] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.435628] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 is going to be updated. [ 1270.439662] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.439795] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.463548] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.463548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.463548] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.464052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.464052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.464138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.464250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.464515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.464602] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40df3b5-39f7-4708-b82e-fdf4adec1e99',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.885647] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.888259] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.966788] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b40df3b5-39f7-4708-b82e-fdf4adec1e99 with status ACTIVE [ 1270.967081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.967248] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.967319] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.967537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.967646] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.967808] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.967911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.967990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.968132] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.968207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.968450] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.968501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.968532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.968670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.968743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.968842] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b40df3b5-39f7-4708-b82e-fdf4adec1e99 is going to be updated. [ 1270.992968] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.993220] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.993286] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.993522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.993702] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.993894] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40df3b5-39f7-4708-b82e-fdf4adec1e99" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.017082] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33728b10-62d7-4dd6-b006-045dd7d855db in Status: SUCCESS [ 1271.017299] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db deletion is rescheduled due to dependency. [ 1271.017416] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.387576] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.387729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.387791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.388568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.388568] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.388568] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd is going to be created. [ 1271.390986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.391121] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.391189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.391386] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.391474] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.391569] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1271.411623] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.411791] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.411844] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.412057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.412221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.418373] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.418529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.418600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.418862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.419018] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.421657] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd in Status: UNINITIALIZED for 2s [ 1271.433281] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1273.433310] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd in Status: SUCCESS [ 1273.433777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.434899] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.435142] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.435355] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.435491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.435562] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.435725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.435817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.435912] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.445380] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1273.445573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.445755] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.445979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.446221] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.446354] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.446425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.446627] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.446758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.446903] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.938418] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.938615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.938615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.939047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.939047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.939174] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.939240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.939327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.939460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.939542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.939660] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd is going to be deleted. [ 1273.949377] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.969543] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.969737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.969737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.969961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.970069] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.970173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.970310] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.970576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.970765] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.970868] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.970929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.971092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.971172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.971264] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.451878] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.474467] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.474669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.474814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.475535] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.475815] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.476103] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.476345] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.476415] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.476585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.476962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.477055] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd already deleted. [ 1274.477141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.478723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.479010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.479783] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.479783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.479783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.479783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.479783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.479783] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.955919] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.956097] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.956172] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.956408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.956504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.956621] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1274.981653] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.981747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.981805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.982058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.982130] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.982400] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.982579] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.982759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.982938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.983107] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.983226] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd already deleted. [ 1274.983269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.983366] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.987240] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.987375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.987375] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.987725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.987814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.999244] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1275.228483] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.228483] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1275.487217] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.742817] env[65973]: INFO networking_nsxv3.common.synchronization [None req-4a064781-46ff-480c-bfe5-f11d97048bd5 None None] Enqueued Resource ID: dff1ce08-97d9-4a6b-be42-b241a1a5b945 with Priority: HIGHEST for action port [ 1275.743406] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dff1ce08-97d9-4a6b-be42-b241a1a5b945 with Priority: HIGHEST for action port [ 1275.743907] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-dff1ce08-97d9-4a6b-be42-b241a1a5b945 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.744123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dff1ce08-97d9-4a6b-be42-b241a1a5b945" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.744123] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dff1ce08-97d9-4a6b-be42-b241a1a5b945" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.745081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dff1ce08-97d9-4a6b-be42-b241a1a5b945" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.745081] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dff1ce08-97d9-4a6b-be42-b241a1a5b945',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.902526] env[65973]: INFO networking_nsxv3.common.synchronization [req-b22dd037-80c8-4974-a1a0-1cbfe9eaf162 req-34fe33fa-377b-470c-a094-530c7a28aa0d tempest-ServerRescueTestJSONUnderV235-745819749 tempest-ServerRescueTestJSONUnderV235-745819749-project-member] Enqueued Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1275.903118] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 with Priority: HIGHEST for action security_group_members [ 1275.903737] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.903737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.989472] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd: rpc.has_security_group_logging(os_id): False [ 1276.006779] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.006939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.006939] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.007174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.007267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.007458] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.008063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.008063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.008063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.008063] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.008063] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd is going to be created. [ 1276.024860] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd], does not exist path=[/infra/domains/default/groups/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd]."\n}' [ 1276.025054] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd [ 1276.025142] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1276.065466] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.065636] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.065709] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.065926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.067348] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.067636] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.067761] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.067812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.067984] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.068075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.068245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.068330] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.068393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.068536] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.068611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.068697] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd is going to be created. [ 1276.097765] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd], does not exist path=[/infra/domains/default/groups/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd [ 1276.097996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.098234] env[65973]: Traceback (most recent call last): [ 1276.098281] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1276.098281] env[65973]: return func(*args, **kwargs) [ 1276.098281] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1276.098281] env[65973]: res.raise_for_status() [ 1276.098281] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1276.098281] env[65973]: raise HTTPError(http_error_msg, response=self) [ 1276.098281] env[65973]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd [ 1276.098281] env[65973]: During handling of the above exception, another exception occurred: [ 1276.098281] env[65973]: Traceback (most recent call last): [ 1276.098281] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1276.098281] env[65973]: listener.cb(fileno) [ 1276.098281] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1276.098281] env[65973]: result = function(*args, **kwargs) [ 1276.098642] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1276.098642] env[65973]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1276.098642] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1276.098642] env[65973]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1276.098642] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1276.098642] env[65973]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1276.098642] env[65973]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1276.098642] env[65973]: res.raise_for_status() [ 1276.098642] env[65973]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1276.098642] env[65973]: raise HTTPError(http_error_msg, response=self) [ 1276.098642] env[65973]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a2bbcee9-bcbb-4735-a08c-4d7c2b378ddd [ 1276.098642] env[65973]: Removing descriptor: 5 [ 1276.247272] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dff1ce08-97d9-4a6b-be42-b241a1a5b945 [ 1276.247628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.247835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.247944] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.248249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.248701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.248769] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dff1ce08-97d9-4a6b-be42-b241a1a5b945 already deleted. [ 1276.249332] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dff1ce08-97d9-4a6b-be42-b241a1a5b945" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.010891] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1277.011303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.011417] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.011602] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.011798] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.011928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.012024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.012183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.012267] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.012366] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.514594] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.514594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.514594] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.514904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.536405] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.536670] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.536790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.536852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.537068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.537154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.537245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1277.568044] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.568228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.568317] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.568628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.568812] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.579075] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1279.596971] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1279.597355] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 deletion is rescheduled due to dependency. [ 1279.597355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.597456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.597840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.597840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.598183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.598183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.598183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.598421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.598421] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.101615] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.101860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.101860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.102079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.102171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.102373] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.102471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.102587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.102758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.102839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.102926] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1280.159431] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.159632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.159632] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.159901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.160138] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.170973] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1280.903880] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.904189] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1282.183839] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1282.184221] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 deletion is rescheduled due to dependency. [ 1282.184221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.184369] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.184542] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.184734] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.184858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.184918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.185082] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.185164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.185249] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.185342] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.186228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.186392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.186548] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.186649] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.186712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.186854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.186931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.187026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.688697] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.690024] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.690024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.690024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.690357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.690357] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.690521] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.690661] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.690732] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.690926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.690926] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.691098] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1282.728179] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.728387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.728387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.728603] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.728817] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.738990] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1283.193395] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3: rpc.has_security_group_logging(os_id): False [ 1283.211470] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.211720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.211720] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.211962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.212052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.212227] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.212323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.212401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.212585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.212673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.212753] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be updated. [ 1283.267338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.267585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.267585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.267757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.267890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.279648] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: IN_PROGRESS for 2s [ 1284.751503] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1284.751902] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 deletion is rescheduled due to dependency. [ 1284.751902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.295595] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 in Status: SUCCESS [ 1285.295847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.295934] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.296270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.296440] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.817144] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.817564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.817564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.817564] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.835854] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.836072] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3 is going to be deleted. [ 1285.882884] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.883114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.883114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.883261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.883353] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.883451] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b7499b7-b55e-43f3-a7cb-3a72b0ab39b3" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.905031] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.905266] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1289.419247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.419799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.419876] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.420153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.420273] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.922717] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.425826] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.906481] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.906722] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.928172] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1290.928433] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1291.728459] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.728911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.728911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.728911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.740821] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1291.741781] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.742958] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1291.784040] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.784313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.784313] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.784443] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.799273] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.799925] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1291.800019] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1291.800112] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1291.841912] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.842203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.842203] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.842314] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.843208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.843376] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1291.916758] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.917030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.917030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.917174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.917494] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.917759] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1291.994168] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.994442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.994442] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.994592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.994888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.995188] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1291.995281] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c83e6a14-269f-4653-a47c-a9fe58834679', 'c59c44f2-4848-4042-b55e-827765296b4c', 'f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2', '75299a7e-f943-422d-b243-adb623b647de', 'b0b456c0-ca3e-4dcf-883f-c2038bcc8151', 'de5c35fe-01e4-45c6-b69d-55e67887ab22', '8da0d868-de85-4818-aa51-4d52389cba32', 'f771ba6a-073a-4849-9576-cace0561d5e9', '40ba655d-4cca-4b1f-9029-3a495c9655b1', '33728b10-62d7-4dd6-b006-045dd7d855db', 'b9b235ba-8426-4bfa-b2c5-84500087d8ea', 'a575d40f-4efb-403b-a9bf-a1d03f827661', 'd1bdd946-26a6-42b9-91bc-053f074c2da1', '7fe395e3-e4a0-40a1-ae54-cd90d98c69f8', '88b4ac05-7dae-4c69-af3f-5a58ae902308', '30ffb193-a19e-4e24-a26f-e10ccbe9a34e', '364ddebc-6f46-4ac6-be33-ab246d291a56', '192ec921-b8c6-4174-b658-05183df07d9e', 'b5b10902-7db9-4679-995c-f5b279ca6ef4', '42226ea0-f68b-4929-8753-fb837ff84263', 'b055eda4-1eeb-41de-ba8a-7910ea006a83', '1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de', '521f64c2-bdc1-44c3-9e8c-c4a684475213', '3b841c0a-397f-4e9d-b02d-5feeaebf26a7', 'a61bfecd-4cd3-4e76-8516-854a7ee1f93b', 'cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29', 'ab67debe-f546-499b-8301-c37179fecdee', '13b6ff97-cb4a-4c76-b07b-2e08a7615d07', 'b8ee6965-6080-4005-80bf-0264af4bd437', '79821cdf-baef-439f-bc9f-8fb2227beed1', 'dcf87a61-c07f-4a06-b6bc-89ada25f6a9e', '1988574b-e8ea-411d-ac4f-bf196438bafb', '8914f4ea-4ed1-4101-ab21-2b15a1da5534', '9dcf9f05-2312-463f-a10f-331dffd06aeb', '2f7b78e3-6775-4a75-a625-09d47728d125', '489f909b-5c83-4f6d-9b65-b33d0f523a47', '5db36d30-53f7-47b0-ac61-28873c168bb5', '9c8604cf-439a-4fd5-aaaf-d59a1eb46a27', '3639d272-10a3-4e14-b0d6-0d00cd61092b', '84af9696-6508-477b-a988-cda90bb86706', '7a7ed067-ae07-49f5-b03a-aa95774538ec', '12bf28a0-51ca-4171-b63e-ba9ad7a0139e', '78d1f177-ec77-4d3a-bc27-48a23b238428', 'fd6acc62-85f3-402a-8a15-8c40c08290a0'} {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1291.995454] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1292.014863] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.015086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.015086] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.015279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.015362] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.015470] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1292.015541] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.015611] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1292.101785] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.101995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.101995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.102170] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.103368] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.103643] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1292.103714] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.103787] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1292.103851] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1292.103925] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1292.103996] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 1292.104088] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGH for action security_group_rules [ 1292.104154] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGH for action security_group_rules [ 1292.104217] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGH for action security_group_rules [ 1292.104282] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGH for action security_group_rules [ 1292.104337] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGH for action security_group_rules [ 1292.104395] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 1292.104453] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGH for action security_group_rules [ 1292.104515] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGH for action security_group_rules [ 1292.104575] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGH for action security_group_rules [ 1292.104634] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGH for action security_group_rules [ 1292.104695] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGH for action security_group_rules [ 1292.104756] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGH for action security_group_rules [ 1292.104809] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGH for action security_group_rules [ 1292.104870] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGH for action security_group_rules [ 1292.104930] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGH for action security_group_rules [ 1292.104992] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGH for action security_group_rules [ 1292.105063] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGH for action security_group_rules [ 1292.105122] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGH for action security_group_rules [ 1292.105178] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGH for action security_group_rules [ 1292.105269] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.907903] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.908308] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1295.908308] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83e6a14-269f-4653-a47c-a9fe58834679 with Priority: HIGH for action security_group_rules [ 1295.908308] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 with Priority: HIGH for action security_group_rules [ 1295.908433] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da0d868-de85-4818-aa51-4d52389cba32 with Priority: HIGH for action security_group_rules [ 1295.908572] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 with Priority: HIGH for action security_group_rules [ 1295.908629] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42226ea0-f68b-4929-8753-fb837ff84263 with Priority: HIGH for action security_group_rules [ 1295.908682] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 with Priority: HIGH for action security_group_rules [ 1295.908782] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192ec921-b8c6-4174-b658-05183df07d9e with Priority: HIGH for action security_group_rules [ 1295.908872] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 with Priority: HIGH for action security_group_rules [ 1295.908963] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 with Priority: HIGH for action security_group_rules [ 1295.909058] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e with Priority: HIGH for action security_group_rules [ 1295.909150] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 with Priority: HIGH for action security_group_rules [ 1295.909237] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a575d40f-4efb-403b-a9bf-a1d03f827661 with Priority: HIGH for action security_group_rules [ 1295.909323] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea with Priority: HIGH for action security_group_rules [ 1295.909408] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33728b10-62d7-4dd6-b006-045dd7d855db with Priority: HIGH for action security_group_rules [ 1295.909493] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGH for action security_group_rules [ 1295.909578] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 with Priority: HIGH for action security_group_rules [ 1295.909666] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f771ba6a-073a-4849-9576-cace0561d5e9 with Priority: HIGH for action security_group_rules [ 1295.909786] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 with Priority: HIGH for action security_group_rules [ 1295.909906] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c44f2-4848-4042-b55e-827765296b4c with Priority: HIGH for action security_group_rules [ 1295.909997] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75299a7e-f943-422d-b243-adb623b647de with Priority: HIGH for action security_group_rules [ 1295.910348] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83e6a14-269f-4653-a47c-a9fe58834679 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.910471] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.910530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.910767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.910848] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83e6a14-269f-4653-a47c-a9fe58834679',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.912131] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.912250] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.912337] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.912482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.912556] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.913340] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8da0d868-de85-4818-aa51-4d52389cba32 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.913446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.913502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.913677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.913773] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8da0d868-de85-4818-aa51-4d52389cba32',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.914478] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b4ac05-7dae-4c69-af3f-5a58ae902308 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.914570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.914635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.914782] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.914854] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b4ac05-7dae-4c69-af3f-5a58ae902308',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.915526] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42226ea0-f68b-4929-8753-fb837ff84263 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.915637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.915689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.915855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.915934] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42226ea0-f68b-4929-8753-fb837ff84263',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.916711] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b10902-7db9-4679-995c-f5b279ca6ef4 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.916818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.916883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.917047] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.917121] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b10902-7db9-4679-995c-f5b279ca6ef4',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.917770] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-192ec921-b8c6-4174-b658-05183df07d9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.917878] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.917943] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.918104] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.918175] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('192ec921-b8c6-4174-b658-05183df07d9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.918818] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-364ddebc-6f46-4ac6-be33-ab246d291a56 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.918921] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.918975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.919136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.919208] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('364ddebc-6f46-4ac6-be33-ab246d291a56',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.919851] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.919985] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.920507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.920698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.920778] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe395e3-e4a0-40a1-ae54-cd90d98c69f8',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.922732] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.922853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.922922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.923068] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.923134] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ffb193-a19e-4e24-a26f-e10ccbe9a34e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.923817] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1bdd946-26a6-42b9-91bc-053f074c2da1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.923931] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.923991] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.924150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.924221] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1bdd946-26a6-42b9-91bc-053f074c2da1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.924864] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a575d40f-4efb-403b-a9bf-a1d03f827661 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.924972] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.925112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.925218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.925292] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a575d40f-4efb-403b-a9bf-a1d03f827661',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.926930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.927061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.927165] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.927639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.927733] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9b235ba-8426-4bfa-b2c5-84500087d8ea',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.929017] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33728b10-62d7-4dd6-b006-045dd7d855db taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.929272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.929272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.929389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.929425] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33728b10-62d7-4dd6-b006-045dd7d855db',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.930606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.930765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.930861] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.931432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.931572] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.933238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de5c35fe-01e4-45c6-b69d-55e67887ab22 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.933383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.933383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.933507] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.933555] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de5c35fe-01e4-45c6-b69d-55e67887ab22',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.934546] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f771ba6a-073a-4849-9576-cace0561d5e9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.934654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.934715] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.934860] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.934935] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f771ba6a-073a-4849-9576-cace0561d5e9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.936081] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.936081] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.936252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.936252] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.936331] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b456c0-ca3e-4dcf-883f-c2038bcc8151',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.936967] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59c44f2-4848-4042-b55e-827765296b4c taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.937364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.937364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.937364] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.937364] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59c44f2-4848-4042-b55e-827765296b4c',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.937997] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75299a7e-f943-422d-b243-adb623b647de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.938120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.938233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.938327] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.938438] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75299a7e-f943-422d-b243-adb623b647de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.966154] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.966154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.966154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.966154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.987336] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.987498] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8da0d868-de85-4818-aa51-4d52389cba32 is going to be deleted. [ 1296.041973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.042241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.042241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.042424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.042499] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.042658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8da0d868-de85-4818-aa51-4d52389cba32" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.434279] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.434587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.434587] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.434718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.434820] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.434914] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.434989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.435153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.435242] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.435318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.435406] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.455878] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.456084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.456084] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.456284] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.470301] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.470561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.498942] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.499152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.501615] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.501741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.507873] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.508046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.508924] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.509052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.509833] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.509955] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.510637] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.510731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.511423] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.511513] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.512399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.512492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.518083] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.518223] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.518839] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.519294] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.519384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.519977] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.520408] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.520530] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33728b10-62d7-4dd6-b006-045dd7d855db is going to be deleted. [ 1296.521516] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.521731] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.523398] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.523502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.524197] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.524290] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.525597] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.525986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.526092] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.530638] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.531057] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.531173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.531845] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.532256] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.532351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.535980] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.536399] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.536497] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.546013] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1296.546532] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.546652] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9b235ba-8426-4bfa-b2c5-84500087d8ea is going to be deleted. [ 1296.547597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.547830] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.584798] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.584972] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de5c35fe-01e4-45c6-b69d-55e67887ab22 is going to be deleted. [ 1296.585852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.586093] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.611259] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.611469] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.615766] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.615935] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.617937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.618058] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 192ec921-b8c6-4174-b658-05183df07d9e is going to be deleted. [ 1296.618902] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.619128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.640726] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.640918] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a575d40f-4efb-403b-a9bf-a1d03f827661 is going to be deleted. [ 1296.641743] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.641956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.654514] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.654705] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.675137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.675308] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75299a7e-f943-422d-b243-adb623b647de is going to be deleted. [ 1296.676221] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.676440] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.694175] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.694373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.707617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.707817] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ffb193-a19e-4e24-a26f-e10ccbe9a34e is going to be deleted. [ 1296.708684] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.708922] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.790312] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.790521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.799771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.799940] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f771ba6a-073a-4849-9576-cace0561d5e9 is going to be deleted. [ 1296.800872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.801112] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.817211] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.817422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.834147] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.834336] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe395e3-e4a0-40a1-ae54-cd90d98c69f8 is going to be deleted. [ 1296.835303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.835625] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.911536] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.911957] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.939419] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.942238] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.942470] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b10902-7db9-4679-995c-f5b279ca6ef4 is going to be deleted. [ 1296.943366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.943608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.963374] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.963585] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.007660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.007865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.015806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.015964] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59c44f2-4848-4042-b55e-827765296b4c is going to be deleted. [ 1297.017262] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.017504] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.089995] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.090193] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42226ea0-f68b-4929-8753-fb837ff84263 is going to be deleted. [ 1297.091163] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.091381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.158195] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.158439] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.179019] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.179246] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.196312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.196505] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2 is going to be deleted. [ 1297.197425] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.197662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.254910] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.255110] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83e6a14-269f-4653-a47c-a9fe58834679 is going to be deleted. [ 1297.255928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.256189] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.270094] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.270307] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.301800] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.301987] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1bdd946-26a6-42b9-91bc-053f074c2da1 is going to be deleted. [ 1297.302904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.303150] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.373961] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.374250] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b4ac05-7dae-4c69-af3f-5a58ae902308 is going to be deleted. [ 1297.375057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.375279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.381412] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.381648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.394034] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.394261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.416024] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.416209] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 364ddebc-6f46-4ac6-be33-ab246d291a56 is going to be deleted. [ 1297.417099] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.417316] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.437211] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.437420] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.442340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.442456] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b456c0-ca3e-4dcf-883f-c2038bcc8151 is going to be deleted. [ 1297.443453] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ba655d-4cca-4b1f-9029-3a495c9655b1: rpc.has_security_group_logging(os_id): False [ 1297.444294] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.444510] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.444601] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.444724] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33728b10-62d7-4dd6-b006-045dd7d855db" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.444886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.445072] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.445197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.445247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9b235ba-8426-4bfa-b2c5-84500087d8ea" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.445918] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.446111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.446183] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.446305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de5c35fe-01e4-45c6-b69d-55e67887ab22" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.446434] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.446582] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.446737] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.446777] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-192ec921-b8c6-4174-b658-05183df07d9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.446886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.447040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.447119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.447226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a575d40f-4efb-403b-a9bf-a1d03f827661" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.447349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.447486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.447561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.447689] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75299a7e-f943-422d-b243-adb623b647de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.447818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.447959] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.448043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.448175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ffb193-a19e-4e24-a26f-e10ccbe9a34e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.448270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.448404] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.448476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.448580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f771ba6a-073a-4849-9576-cace0561d5e9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.448699] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.448835] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.448907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.449021] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe395e3-e4a0-40a1-ae54-cd90d98c69f8" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.449144] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.449278] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.449349] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.449453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b10902-7db9-4679-995c-f5b279ca6ef4" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.449573] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.449703] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.449776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.449881] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59c44f2-4848-4042-b55e-827765296b4c" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.450008] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.450173] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.450272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.450423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42226ea0-f68b-4929-8753-fb837ff84263" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.450556] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.450697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.450771] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.450875] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3dfa3f3-65e1-42cd-acd0-2c7eeb8eb5c2" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.451031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.451174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.451247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.451355] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83e6a14-269f-4653-a47c-a9fe58834679" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.451479] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.451611] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.451681] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.451786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1bdd946-26a6-42b9-91bc-053f074c2da1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.490307] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.490574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.490574] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.490722] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.502964] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.503227] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.548840] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.549083] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.549981] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.550322] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.550441] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.550484] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.550729] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.550831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.550931] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1297.551970] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.552175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.552261] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.552366] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b4ac05-7dae-4c69-af3f-5a58ae902308" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.552543] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.552783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.552864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.552969] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-364ddebc-6f46-4ac6-be33-ab246d291a56" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.595352] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.595614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.595614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.595763] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.595858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.595983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b456c0-ca3e-4dcf-883f-c2038bcc8151" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.709299] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.710010] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.710175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.710350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.710555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.710758] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.739365] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1299.755097] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1299.755491] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.911318] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.911665] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.912710] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.913207] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.914557] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.914927] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.915426] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.915814] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.563070] env[65973]: INFO networking_nsxv3.common.synchronization [req-b19df2c2-2eee-4b51-954b-d9b8c7f0fbc1 req-db4ad786-1799-41f0-9b6a-80270ca9e304 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1320.563578] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGHEST for action security_group_members [ 1320.563908] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.564141] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.564233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.564437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.564596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.564698] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.564757] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.564907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.564992] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.565097] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.068235] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.068446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.068446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.068616] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.099341] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.099616] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.099741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.099809] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.100036] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.101196] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.101196] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 is going to be updated. [ 1321.134000] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.134206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.134401] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.134460] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.134598] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.143956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: IN_PROGRESS for 2s [ 1323.154836] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 in Status: SUCCESS [ 1323.155201] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 deletion is rescheduled due to dependency. [ 1323.155201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.564720] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.565126] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.565889] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.566309] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.567125] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.567590] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.567688] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.568123] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.569021] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.569480] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.570923] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.570923] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.694239] env[65973]: INFO networking_nsxv3.common.synchronization [req-e2ff14bd-b0cd-4cc7-ad28-a688927d1a1f req-490c5332-6729-4a39-a867-a1045a0aa6ce tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1351.694812] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1351.695139] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.695298] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.695360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.695592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.695764] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.695764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.695979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.695979] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.696111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.696218] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.198415] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.198622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.198622] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.198853] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.198942] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.199148] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.199270] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.199325] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.199446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.199517] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.199599] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1352.229461] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.229701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.229701] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.229862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.230011] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.238893] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1354.250596] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1354.250998] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 deletion is rescheduled due to dependency. [ 1354.250998] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.695507] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.695868] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.585621] env[65973]: INFO networking_nsxv3.common.synchronization [req-270a6220-1a04-478c-a35d-f7b8a130bad4 req-989bda37-6e39-4878-ae11-d3f75e19e290 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1358.585956] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1358.586292] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.586418] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.586477] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.586675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.586832] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.586949] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.587175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.587371] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.587527] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.587622] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.844410] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.844577] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.844577] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.844809] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.845212] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.845392] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.845511] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.845727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.845873] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.846124] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.846244] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1358.846352] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1358.846462] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1358.846570] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.846674] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1358.846801] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1358.869588] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1358.869780] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1358.869879] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1358.870067] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.870389] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-4ff8de95-68fe-410a-b99b-95179b8f9a8a taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.870554] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.870671] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.871108] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.871309] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff8de95-68fe-410a-b99b-95179b8f9a8a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.090280] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.090483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.090483] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.090650] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.090742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.090969] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.091111] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.091169] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.091320] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.091398] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.091487] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1359.116685] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.116891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.116891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.117079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.117235] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.125943] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1359.373939] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.374201] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.374329] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.374621] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.374771] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.374921] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 4ff8de95-68fe-410a-b99b-95179b8f9a8a not found, creating... [ 1359.375210] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.375371] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.375482] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.375776] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.375963] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.376369] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.376588] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.376732] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.377015] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.377156] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.377302] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 4ff8de95-68fe-410a-b99b-95179b8f9a8a is going to be created. [ 1359.398549] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.398721] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.398813] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.399091] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.399322] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.399540] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.081972] env[65973]: INFO networking_nsxv3.common.synchronization [req-270a6220-1a04-478c-a35d-f7b8a130bad4 req-1beacc02-eb6a-4abd-9248-87399c4583b5 service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1360.082311] env[65973]: INFO networking_nsxv3.common.synchronization [req-270a6220-1a04-478c-a35d-f7b8a130bad4 req-1beacc02-eb6a-4abd-9248-87399c4583b5 service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1360.082311] env[65973]: INFO networking_nsxv3.common.synchronization [req-270a6220-1a04-478c-a35d-f7b8a130bad4 req-1beacc02-eb6a-4abd-9248-87399c4583b5 service nova] Enqueued Resource ID: 4ff8de95-68fe-410a-b99b-95179b8f9a8a with Priority: HIGHEST for action port [ 1360.082774] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1360.082903] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1360.085158] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff8de95-68fe-410a-b99b-95179b8f9a8a with Priority: HIGHEST for action port [ 1360.085516] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.085664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.085787] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.086044] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.086137] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.087161] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.087231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.087708] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff8de95-68fe-410a-b99b-95179b8f9a8a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.087872] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.089671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.089671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.089671] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff8de95-68fe-410a-b99b-95179b8f9a8a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.590676] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.590676] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.590867] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ff8de95-68fe-410a-b99b-95179b8f9a8a with status ACTIVE [ 1360.590985] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.591213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.591213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.591407] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.591500] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.591671] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.591766] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.591826] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.591974] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.592066] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.592245] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.592335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.592392] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.592525] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.592597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.592678] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ff8de95-68fe-410a-b99b-95179b8f9a8a is going to be updated. [ 1360.614763] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.614983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.614983] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.615247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.615454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.615628] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff8de95-68fe-410a-b99b-95179b8f9a8a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.135103] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1361.135382] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 deletion is rescheduled due to dependency. [ 1361.135382] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.135534] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.135925] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.135925] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.136057] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.136120] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.136237] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.136342] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.136448] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.638291] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.140526] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.643209] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.643383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.643448] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.643658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.643744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.643840] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1362.671440] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.671576] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.671651] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.671869] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.672033] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.680653] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1364.691453] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 4s [ 1365.085929] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.086194] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1366.702881] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1366.703323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.703323] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.703493] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.703684] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.703797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.703858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.704023] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.704131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.704241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.704337] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.206796] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.708832] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ba655d-4cca-4b1f-9029-3a495c9655b1: rpc.has_security_group_logging(os_id): False [ 1367.727140] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.727381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.727523] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.727652] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.727740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.727991] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.728106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.728171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.728329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.728406] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.728493] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1367.792949] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.793206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.793206] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.793423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.793566] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.807480] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1369.821860] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1369.822259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.087361] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.087552] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.087979] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.088346] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.088917] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.089354] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.089700] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.090091] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.090957] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.091390] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.092294] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.092713] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.093224] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.093672] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.095256] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.095668] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.097115] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.097595] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.098793] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.099216] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.099430] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.099802] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.100477] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.100872] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.102427] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.102808] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.103780] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.104212] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.841654] env[65973]: INFO networking_nsxv3.common.synchronization [req-cf2bc90e-2b92-4eff-9757-44a13b216d9e req-4ce54f54-f3f2-4f03-b3cd-7bbc6dac6dab tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1439.842118] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1439.842560] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.842560] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.842740] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.842803] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.842956] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.843058] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.843119] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.843259] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.843340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.843430] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.345976] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.346210] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.346257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.346444] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.346537] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.346733] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.346827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.346886] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.347041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.347117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.347201] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1440.387225] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.387422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.387422] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.387621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.387727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.396206] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1442.407735] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1442.407735] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 deletion is rescheduled due to dependency. [ 1442.407735] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.843441] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.843739] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.723798] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f5a8262-4643-4b81-9180-0e25ecef580f req-1cac4032-44ca-4adb-8d14-9de156029479 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1446.724406] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1446.724660] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.724797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.724865] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.725197] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.725366] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.725476] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.725518] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.725679] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.725767] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.725860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.017034] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.017335] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.017540] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.017942] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.018385] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.018701] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.018910] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.019174] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.019315] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.019524] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1447.019634] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1447.019742] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1447.019850] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1447.019956] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1447.020080] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1447.020212] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1447.041680] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1447.041851] env[65973]: DEBUG dogpile.cache.region [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1447.041993] env[65973]: DEBUG dogpile.lock [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1447.042181] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "network-422" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.042589] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock port-154cefef-158a-4f46-a226-936b7cae5ea1 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.042762] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.042879] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.043278] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.043417] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('154cefef-158a-4f46-a226-936b7cae5ea1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.228014] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.228240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.228240] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.228463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.228552] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.228741] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.228842] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.228915] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.229079] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.229153] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.229237] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1447.255293] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.255515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.255515] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.255687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.255827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.265026] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1447.546345] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.546576] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.546702] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.547010] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.547157] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.547314] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Segment Port 154cefef-158a-4f46-a226-936b7cae5ea1 not found, creating... [ 1447.547575] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.547727] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.547843] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.548072] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.548208] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.548482] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.548631] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.548747] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.548954] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.549094] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.549231] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Resource: SegmentPort with ID: 154cefef-158a-4f46-a226-936b7cae5ea1 is going to be created. [ 1447.570139] env[65973]: DEBUG networking_nsxv3.common.locking [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.570365] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.570462] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.570729] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.570960] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.571189] env[65973]: DEBUG oslo_concurrency.lockutils [None req-a67f9cbc-43f0-4784-8197-d39da753c27c None None] Releasing lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.252218] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f5a8262-4643-4b81-9180-0e25ecef580f req-0fdcf167-2bef-4d3f-9df2-123be2264171 service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1448.252513] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f5a8262-4643-4b81-9180-0e25ecef580f req-0fdcf167-2bef-4d3f-9df2-123be2264171 service nova] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1448.252513] env[65973]: INFO networking_nsxv3.common.synchronization [req-2f5a8262-4643-4b81-9180-0e25ecef580f req-0fdcf167-2bef-4d3f-9df2-123be2264171 service nova] Enqueued Resource ID: 154cefef-158a-4f46-a226-936b7cae5ea1 with Priority: HIGHEST for action port [ 1448.253042] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_rules [ 1448.253178] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1448.253268] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154cefef-158a-4f46-a226-936b7cae5ea1 with Priority: HIGHEST for action port [ 1448.253665] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.253837] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.253903] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.254117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.254201] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.255101] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.256100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.257272] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-154cefef-158a-4f46-a226-936b7cae5ea1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.257390] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.257452] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.257635] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.257713] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('154cefef-158a-4f46-a226-936b7cae5ea1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.759816] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.760076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.760125] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 154cefef-158a-4f46-a226-936b7cae5ea1 with status ACTIVE [ 1448.760270] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.760377] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.760436] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.760654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.760748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.760917] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.761075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.761075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.761228] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.761305] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.761489] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.761600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.761658] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.761802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.761874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.761958] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 154cefef-158a-4f46-a226-936b7cae5ea1 is going to be updated. [ 1448.782475] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.782685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.782685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.782856] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.782990] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.783158] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-154cefef-158a-4f46-a226-936b7cae5ea1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.274951] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1449.275394] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 deletion is rescheduled due to dependency. [ 1449.275394] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.275488] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.275674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.275851] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.276055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.276055] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.276187] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.276277] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.276416] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.778748] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.281346] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.783539] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.783727] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.783805] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.784031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.784131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.784245] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1450.810895] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.811073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.811122] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.811312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.811455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.820129] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1452.831531] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1452.831946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.831946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.832077] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.832271] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.832391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.832455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.832613] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.832696] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.832783] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.832873] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.254529] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.254775] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1453.335359] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.837731] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ba655d-4cca-4b1f-9029-3a495c9655b1: rpc.has_security_group_logging(os_id): False [ 1453.855773] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.856010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.856010] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.856218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.856312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.856571] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.856675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.856741] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.856891] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.856966] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.857070] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1453.917824] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.918064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.918114] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.918351] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.918498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.932504] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1455.949373] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1455.949813] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.255464] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.255858] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.256262] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.256648] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.259094] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.259534] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.259957] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.260348] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.261314] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.262066] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.262760] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.263283] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.482697] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1487.482697] env[65973]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4390cc1a-1af9-44f3-a1bd-b0a7c3ef519a None None] NSXv3 Agent Agent loop - iteration:4 started [ 1488.264278] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.264466] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.265166] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.265557] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.267016] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.267392] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.268121] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.268559] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.269324] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.269672] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.130325] env[65973]: INFO networking_nsxv3.common.synchronization [req-2af33465-2a2f-490b-8a4e-268981de11c5 req-760d7d9b-8543-4ec7-bf7f-fb49d2a8efb7 tempest-ServerActionsTestJSON-1107556418 tempest-ServerActionsTestJSON-1107556418-project-member] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1509.130987] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGHEST for action security_group_members [ 1509.130987] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.130987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.130987] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.131257] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.131669] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.131669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.131669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.131669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.131669] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.131915] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.633867] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.634318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.634318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.634318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.634445] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.634577] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.634687] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.634748] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.634956] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.635054] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.635156] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be updated. [ 1509.669331] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.669551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.669551] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.669637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.669811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.677474] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 2s [ 1511.689021] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: IN_PROGRESS for 4s [ 1513.699644] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 in Status: SUCCESS [ 1513.700129] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 deletion is rescheduled due to dependency. [ 1513.700129] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.133370] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.133521] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.084248] env[65973]: INFO networking_nsxv3.common.synchronization [None req-fd2de772-9f05-40f0-a3d5-ac5ffd104411 None None] Enqueued Resource ID: c382c413-97f8-4271-8991-1068fda40fff with Priority: HIGHEST for action port [ 1517.084807] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c382c413-97f8-4271-8991-1068fda40fff with Priority: HIGHEST for action port [ 1517.085417] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-c382c413-97f8-4271-8991-1068fda40fff taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.085621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c382c413-97f8-4271-8991-1068fda40fff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.085940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c382c413-97f8-4271-8991-1068fda40fff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.086463] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c382c413-97f8-4271-8991-1068fda40fff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.086523] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c382c413-97f8-4271-8991-1068fda40fff',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.589776] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c382c413-97f8-4271-8991-1068fda40fff [ 1517.590020] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.590159] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.590230] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.590450] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.590539] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.590631] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c382c413-97f8-4271-8991-1068fda40fff already deleted. [ 1517.590708] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c382c413-97f8-4271-8991-1068fda40fff" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.128492] env[65973]: INFO networking_nsxv3.common.synchronization [None req-be7d542f-e908-4bfa-8f73-1e6572f20e73 None None] Enqueued Resource ID: 8cc6fd4a-1026-4e33-8973-ffde2ea0d76a with Priority: HIGHEST for action port [ 1519.129028] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc6fd4a-1026-4e33-8973-ffde2ea0d76a with Priority: HIGHEST for action port [ 1519.129337] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc6fd4a-1026-4e33-8973-ffde2ea0d76a taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.129456] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc6fd4a-1026-4e33-8973-ffde2ea0d76a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.129522] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc6fd4a-1026-4e33-8973-ffde2ea0d76a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.129770] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc6fd4a-1026-4e33-8973-ffde2ea0d76a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.129850] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc6fd4a-1026-4e33-8973-ffde2ea0d76a',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.632246] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cc6fd4a-1026-4e33-8973-ffde2ea0d76a [ 1519.632477] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.632614] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.632685] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.632883] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.632977] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.633085] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cc6fd4a-1026-4e33-8973-ffde2ea0d76a already deleted. [ 1519.633168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc6fd4a-1026-4e33-8973-ffde2ea0d76a" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.345018] env[65973]: INFO networking_nsxv3.common.synchronization [req-adfdce3f-c620-4320-a3da-49c65d360cc0 req-ae93ec42-695e-4a2e-bc2a-f915ae36f4cf tempest-ServerPasswordTestJSON-1280409321 tempest-ServerPasswordTestJSON-1280409321-project-member] Enqueued Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1522.345595] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1522.345904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.346060] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.346136] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.346381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.346555] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.346666] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.346745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.346866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.346938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.347038] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.616926] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock network-440 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.617182] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.617265] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.617527] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.617794] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.617947] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.618072] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.618290] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.618430] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.618641] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1522.618750] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] NeedRegenerationException {{(pid=65973) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1522.618859] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] no value, waiting for create lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1522.618980] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] value creation lock acquired {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1522.619076] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] No value present for key: 'zone-id' {{(pid=65973) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1522.619181] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Calling creation function for not-yet-present value {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1522.619309] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1522.639928] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1522.640195] env[65973]: DEBUG dogpile.cache.region [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65973) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1522.640258] env[65973]: DEBUG dogpile.lock [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Released creation lock {{(pid=65973) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1522.640472] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "network-440" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.640956] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock port-82fe8237-dd57-40a9-a90c-3cf86a79ae57 taken with stack trace [, , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.641248] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.641476] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.641936] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.642216] env[65973]: DEBUG networking_nsxv3.api.rpc [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fe8237-dd57-40a9-a90c-3cf86a79ae57',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.849384] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.849644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.849644] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.849759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.849840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.850052] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.850161] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.850208] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.850361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.850437] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.850518] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 already deleted. [ 1522.850597] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.144912] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.145139] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.145242] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.145504] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.145651] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.145841] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Segment Port 82fe8237-dd57-40a9-a90c-3cf86a79ae57 not found, creating... [ 1523.146200] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.146422] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.146560] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.146781] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.146918] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.147227] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.147421] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.147544] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.147761] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.147911] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.148077] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Resource: SegmentPort with ID: 82fe8237-dd57-40a9-a90c-3cf86a79ae57 is going to be created. [ 1523.168033] env[65973]: DEBUG networking_nsxv3.common.locking [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.168233] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.168353] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.168626] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.168856] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.169150] env[65973]: DEBUG oslo_concurrency.lockutils [None req-ab86e8c3-d637-4e3d-91b8-6bc706c2b3c8 None None] Releasing lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.858418] env[65973]: INFO networking_nsxv3.common.synchronization [req-adfdce3f-c620-4320-a3da-49c65d360cc0 req-60143098-943e-4027-9a4b-6477c5365c86 service nova] Enqueued Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_rules [ 1523.858670] env[65973]: INFO networking_nsxv3.common.synchronization [req-adfdce3f-c620-4320-a3da-49c65d360cc0 req-60143098-943e-4027-9a4b-6477c5365c86 service nova] Enqueued Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1523.858781] env[65973]: INFO networking_nsxv3.common.synchronization [req-adfdce3f-c620-4320-a3da-49c65d360cc0 req-60143098-943e-4027-9a4b-6477c5365c86 service nova] Enqueued Resource ID: 82fe8237-dd57-40a9-a90c-3cf86a79ae57 with Priority: HIGHEST for action port [ 1523.859352] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_rules [ 1523.859490] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1523.859586] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fe8237-dd57-40a9-a90c-3cf86a79ae57 with Priority: HIGHEST for action port [ 1523.859905] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.860042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.860106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.860391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.860486] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.861652] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.861774] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.861818] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.861997] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.862143] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.862234] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.862292] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.863040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.863040] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.863040] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.864032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock port-82fe8237-dd57-40a9-a90c-3cf86a79ae57 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.864032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.864032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.864032] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.864032] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fe8237-dd57-40a9-a90c-3cf86a79ae57',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.365608] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.365608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.366023] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.366769] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82fe8237-dd57-40a9-a90c-3cf86a79ae57 with status ACTIVE [ 1524.366938] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.367075] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.367157] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.367333] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.367414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.367584] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.367677] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.367747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.367890] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.367960] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.369247] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.369247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.369247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.369247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.369247] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.369247] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82fe8237-dd57-40a9-a90c-3cf86a79ae57 is going to be updated. [ 1524.390502] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.390831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.390831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.390996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.391080] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.391199] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82fe8237-dd57-40a9-a90c-3cf86a79ae57" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.870232] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.373338] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.373529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.373529] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.373712] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.373811] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.373909] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 is going to be created. [ 1525.398674] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.398904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.398904] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.399490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.399490] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.409223] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: UNINITIALIZED for 2s [ 1527.420651] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: SUCCESS [ 1527.421064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.421064] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.421243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.421435] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.421553] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.421617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.421769] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.421849] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.421938] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.422045] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.924911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.924911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.924911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.924911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.924911] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.924911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.924911] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.925578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.925578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.925578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.925578] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.925578] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.925802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.925802] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.925930] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.926065] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.926131] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.926279] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.926384] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.926502] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.926593] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.429533] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eea9594c-9374-41a0-a792-b1cfad2ca4a9: rpc.has_security_group_logging(os_id): False [ 1528.451023] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.451338] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.451423] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.451697] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.451933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.452177] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.452335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.452428] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.452674] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.452814] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.453126] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.453288] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.453389] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.453618] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.453738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.454032] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.454272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.454272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.454400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.454511] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.454647] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 is going to be created. [ 1528.527238] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.527521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.527521] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.527615] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.527823] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.539028] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: IN_PROGRESS for 2s [ 1528.860780] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.861021] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1529.416877] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.417217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.417217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.417421] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.417550] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.922026] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.424338] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.551711] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: SUCCESS [ 1530.551892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.926327] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1530.926712] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1531.775986] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.775986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.775986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.775986] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.788813] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1531.789672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.790560] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1531.844344] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.844608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.844608] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.844840] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.861282] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.862230] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1531.862311] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1531.862399] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1531.905603] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.905816] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.905933] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.906145] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.906871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.907053] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1531.995628] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.996117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.996117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.996117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.996365] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.996644] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1532.089269] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.089508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.089508] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.089682] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.089989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.090290] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1532.090379] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'84af9696-6508-477b-a988-cda90bb86706', 'a61bfecd-4cd3-4e76-8516-854a7ee1f93b', 'b055eda4-1eeb-41de-ba8a-7910ea006a83', '3b841c0a-397f-4e9d-b02d-5feeaebf26a7', '1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de', '521f64c2-bdc1-44c3-9e8c-c4a684475213', 'cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29', '40ba655d-4cca-4b1f-9029-3a495c9655b1', 'ab67debe-f546-499b-8301-c37179fecdee', '13b6ff97-cb4a-4c76-b07b-2e08a7615d07', 'b8ee6965-6080-4005-80bf-0264af4bd437', '79821cdf-baef-439f-bc9f-8fb2227beed1', 'dcf87a61-c07f-4a06-b6bc-89ada25f6a9e', '1988574b-e8ea-411d-ac4f-bf196438bafb', '8914f4ea-4ed1-4101-ab21-2b15a1da5534', '9dcf9f05-2312-463f-a10f-331dffd06aeb', '2f7b78e3-6775-4a75-a625-09d47728d125', '489f909b-5c83-4f6d-9b65-b33d0f523a47', '5db36d30-53f7-47b0-ac61-28873c168bb5', '9c8604cf-439a-4fd5-aaaf-d59a1eb46a27', '3639d272-10a3-4e14-b0d6-0d00cd61092b', 'eea9594c-9374-41a0-a792-b1cfad2ca4a9', '7a7ed067-ae07-49f5-b03a-aa95774538ec', '12bf28a0-51ca-4171-b63e-ba9ad7a0139e', '78d1f177-ec77-4d3a-bc27-48a23b238428', 'fd6acc62-85f3-402a-8a15-8c40c08290a0'} {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.090468] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1532.111334] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.111519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.111519] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.111675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.111764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.111873] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1532.111943] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.112016] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1532.226437] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.226713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.226713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.226917] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.228387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.228387] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1532.228387] env[65973]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65973) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1532.228606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1532.228606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1532.228606] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1532.228735] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGH for action security_group_rules [ 1532.228735] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGH for action security_group_rules [ 1532.228888] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGH for action security_group_rules [ 1532.228888] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGH for action security_group_rules [ 1532.228888] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGH for action security_group_rules [ 1532.229034] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGH for action security_group_rules [ 1532.229034] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGH for action security_group_rules [ 1532.229123] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGH for action security_group_rules [ 1532.229123] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGH for action security_group_rules [ 1532.229207] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGH for action security_group_rules [ 1532.229248] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGH for action security_group_rules [ 1532.229292] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGH for action security_group_rules [ 1532.229331] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGH for action security_group_rules [ 1532.229443] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGH for action security_group_rules [ 1532.229443] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGH for action security_group_rules [ 1532.229541] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGH for action security_group_rules [ 1532.229615] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGH for action security_group_rules [ 1532.229615] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGH for action security_group_rules [ 1532.229738] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGH for action security_group_rules [ 1532.229738] env[65973]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGH for action security_group_rules [ 1532.229847] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.496841] env[65973]: INFO networking_nsxv3.common.synchronization [req-c8d7bd55-417f-4306-9995-9c4e81914519 req-bbd72fb6-afa7-442e-a398-0106f1bec92d tempest-ServerPasswordTestJSON-1280409321 tempest-ServerPasswordTestJSON-1280409321-project-member] Enqueued Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1533.497623] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 with Priority: HIGHEST for action security_group_members [ 1533.497855] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84af9696-6508-477b-a988-cda90bb86706 with Priority: HIGH for action security_group_rules [ 1533.498062] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 with Priority: HIGH for action security_group_rules [ 1533.498244] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 with Priority: HIGH for action security_group_rules [ 1533.498424] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 with Priority: HIGH for action security_group_rules [ 1533.498623] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 with Priority: HIGH for action security_group_rules [ 1533.499193] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 with Priority: HIGH for action security_group_rules [ 1533.499193] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 with Priority: HIGH for action security_group_rules [ 1533.499378] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7b78e3-6775-4a75-a625-09d47728d125 with Priority: HIGH for action security_group_rules [ 1533.499480] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988574b-e8ea-411d-ac4f-bf196438bafb with Priority: HIGH for action security_group_rules [ 1533.499721] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb with Priority: HIGH for action security_group_rules [ 1533.499859] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e with Priority: HIGH for action security_group_rules [ 1533.499948] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 with Priority: HIGH for action security_group_rules [ 1533.500125] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ee6965-6080-4005-80bf-0264af4bd437 with Priority: HIGH for action security_group_rules [ 1533.500281] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 with Priority: HIGH for action security_group_rules [ 1533.500389] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab67debe-f546-499b-8301-c37179fecdee with Priority: HIGH for action security_group_rules [ 1533.500478] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 with Priority: HIGH for action security_group_rules [ 1533.500575] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 with Priority: HIGH for action security_group_rules [ 1533.500662] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de with Priority: HIGH for action security_group_rules [ 1533.500750] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b with Priority: HIGH for action security_group_rules [ 1533.500837] env[65973]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 with Priority: HIGH for action security_group_rules [ 1533.501165] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea9594c-9374-41a0-a792-b1cfad2ca4a9 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.501285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.501403] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.501569] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.503111] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.503272] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.503387] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.503629] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.503756] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.503896] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea9594c-9374-41a0-a792-b1cfad2ca4a9',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.504926] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84af9696-6508-477b-a988-cda90bb86706 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.505090] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.505155] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.505343] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.505453] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84af9696-6508-477b-a988-cda90bb86706',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.506326] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b055eda4-1eeb-41de-ba8a-7910ea006a83 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.506486] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.507174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.507174] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.507174] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b055eda4-1eeb-41de-ba8a-7910ea006a83',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.507975] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.507975] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.508190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.508845] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.508845] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.508958] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.509472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.509472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.509472] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.509692] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8914f4ea-4ed1-4101-ab21-2b15a1da5534',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.510638] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.510759] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.510819] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.511022] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.511371] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c8604cf-439a-4fd5-aaaf-d59a1eb46a27',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.511960] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db36d30-53f7-47b0-ac61-28873c168bb5 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.512098] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.512215] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.512446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.512576] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db36d30-53f7-47b0-ac61-28873c168bb5',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.514839] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-489f909b-5c83-4f6d-9b65-b33d0f523a47 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.514839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.514839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.514839] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.514839] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('489f909b-5c83-4f6d-9b65-b33d0f523a47',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.515155] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7b78e3-6775-4a75-a625-09d47728d125 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.517765] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7b78e3-6775-4a75-a625-09d47728d125',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.517765] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1988574b-e8ea-411d-ac4f-bf196438bafb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.517765] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.517765] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1988574b-e8ea-411d-ac4f-bf196438bafb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.518621] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dcf9f05-2312-463f-a10f-331dffd06aeb taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.518786] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.518906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.519152] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.519282] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dcf9f05-2312-463f-a10f-331dffd06aeb',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.520630] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.520630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.520630] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.521067] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.521067] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf87a61-c07f-4a06-b6bc-89ada25f6a9e',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.521868] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79821cdf-baef-439f-bc9f-8fb2227beed1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.522046] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.522360] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.522430] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.522598] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79821cdf-baef-439f-bc9f-8fb2227beed1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.523442] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ee6965-6080-4005-80bf-0264af4bd437 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.523617] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.523717] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.523928] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.524075] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ee6965-6080-4005-80bf-0264af4bd437',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.525029] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.525243] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.525335] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.525750] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.525750] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b6ff97-cb4a-4c76-b07b-2e08a7615d07',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.528424] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab67debe-f546-499b-8301-c37179fecdee taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.528424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.528424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.528424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.528424] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab67debe-f546-499b-8301-c37179fecdee',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.528867] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521f64c2-bdc1-44c3-9e8c-c4a684475213 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.528867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.528867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.528867] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.529149] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521f64c2-bdc1-44c3-9e8c-c4a684475213',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.529849] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ba655d-4cca-4b1f-9029-3a495c9655b1 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.529973] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.530031] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.530482] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.530579] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ba655d-4cca-4b1f-9029-3a495c9655b1',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.531325] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.531492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.531492] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.531672] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.531672] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.532505] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.532619] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.532664] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.532788] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.532860] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a61bfecd-4cd3-4e76-8516-854a7ee1f93b',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.533596] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7 taken with stack trace [, , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.533707] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.533747] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.533900] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.533971] env[65973]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b841c0a-397f-4e9d-b02d-5feeaebf26a7',) {} {{(pid=65973) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.537228] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.537388] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.537455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.537584] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.726494] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.726797] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.727376] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.727478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.729198] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.729397] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.729503] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.729561] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.729776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.729879] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.729956] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 is going to be updated. [ 1533.731476] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.731592] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.731660] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.731793] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.751190] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.751399] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 489f909b-5c83-4f6d-9b65-b33d0f523a47 is going to be deleted. [ 1533.752106] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.752329] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.758402] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.758654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.758723] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.759042] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.759253] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.767669] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: IN_PROGRESS for 2s [ 1533.771549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.771656] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84af9696-6508-477b-a988-cda90bb86706 is going to be deleted. [ 1533.772501] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.772711] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.792950] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.793196] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b055eda4-1eeb-41de-ba8a-7910ea006a83 is going to be deleted. [ 1533.827220] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.827531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.827531] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.827713] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.827799] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.827929] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-489f909b-5c83-4f6d-9b65-b33d0f523a47" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.828724] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.828827] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.828895] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.829530] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.829670] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.829745] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84af9696-6508-477b-a988-cda90bb86706" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.849623] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.849821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.849821] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.850016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.850113] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.850231] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b055eda4-1eeb-41de-ba8a-7910ea006a83" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.062772] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.063048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.063048] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.063346] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.067232] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.067454] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.068092] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.068207] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.070971] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.071156] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.098606] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.098855] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.104618] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.104871] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.105948] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.106100] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.107077] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.107213] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.108267] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.108419] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.109410] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.109570] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.112631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.112788] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79821cdf-baef-439f-bc9f-8fb2227beed1 is going to be deleted. [ 1534.114030] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.114383] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.116887] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.117076] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.117764] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.117888] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.118668] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.119214] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.119361] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.120323] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.120719] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.120831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.121435] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.121815] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.121937] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.128414] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.128904] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.129038] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.129721] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.130138] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.130299] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.139174] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.139599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.139721] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b6ff97-cb4a-4c76-b07b-2e08a7615d07 is going to be deleted. [ 1534.140825] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.141126] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.160621] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.160774] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a61bfecd-4cd3-4e76-8516-854a7ee1f93b is going to be deleted. [ 1534.161662] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.161874] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.177644] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.177824] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.181016] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.181016] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29 is going to be deleted. [ 1534.181446] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.181671] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.201906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.202067] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab67debe-f546-499b-8301-c37179fecdee is going to be deleted. [ 1534.202963] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.203191] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.215989] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.216217] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.224648] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.224786] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521f64c2-bdc1-44c3-9e8c-c4a684475213 is going to be deleted. [ 1534.225654] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.225864] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.227204] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.227318] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.240679] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.240862] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.281404] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.281647] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.283025] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.283159] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ba655d-4cca-4b1f-9029-3a495c9655b1 is going to be deleted. [ 1534.284201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.284414] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.328464] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.328718] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.352892] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.353152] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1988574b-e8ea-411d-ac4f-bf196438bafb is going to be deleted. [ 1534.354533] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.354852] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.399591] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.399786] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c8604cf-439a-4fd5-aaaf-d59a1eb46a27 is going to be deleted. [ 1534.400790] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.401043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.446241] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.446433] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de is going to be deleted. [ 1534.447350] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.447580] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.496137] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.496327] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dcf9f05-2312-463f-a10f-331dffd06aeb is going to be deleted. [ 1534.497489] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.497764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.535218] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.535406] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db36d30-53f7-47b0-ac61-28873c168bb5 is going to be deleted. [ 1534.536181] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.536400] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.555335] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.555555] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.566359] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.566549] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.567241] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.567340] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.578196] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.578393] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.589105] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.589248] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8914f4ea-4ed1-4101-ab21-2b15a1da5534 is going to be deleted. [ 1534.590164] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.590381] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.603973] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.604226] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.604948] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.605052] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.613411] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.613542] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b841c0a-397f-4e9d-b02d-5feeaebf26a7 is going to be deleted. [ 1534.614432] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.614637] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.639171] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.639341] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7b78e3-6775-4a75-a625-09d47728d125 is going to be deleted. [ 1534.640211] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.640424] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.687958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.688185] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ee6965-6080-4005-80bf-0264af4bd437 is going to be deleted. [ 1534.689061] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.689285] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.741718] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.741962] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.755978] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.756127] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.762455] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.762588] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf87a61-c07f-4a06-b6bc-89ada25f6a9e is going to be deleted. [ 1534.763866] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.764154] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.764289] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.764453] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79821cdf-baef-439f-bc9f-8fb2227beed1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.764639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.764831] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.764932] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.765117] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b6ff97-cb4a-4c76-b07b-2e08a7615d07" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.765643] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.765806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.765906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.766034] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a61bfecd-4cd3-4e76-8516-854a7ee1f93b" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.766168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.766321] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.766391] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.766509] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cea2c11f-94f0-41ae-b9f2-dbe1aa05ff29" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.766634] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.766776] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.766901] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.766958] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab67debe-f546-499b-8301-c37179fecdee" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.767091] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.767233] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.767308] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.767412] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521f64c2-bdc1-44c3-9e8c-c4a684475213" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.767538] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.767673] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.767742] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.767850] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1988574b-e8ea-411d-ac4f-bf196438bafb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.767978] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.768128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.768201] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.768312] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ba655d-4cca-4b1f-9029-3a495c9655b1" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.768433] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.768567] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.768639] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.768738] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c8604cf-439a-4fd5-aaaf-d59a1eb46a27" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.768858] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.768989] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.769073] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.769175] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1535fc2a-34ff-4cdc-90e8-3e0a4a72c2de" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.769297] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.769429] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.769498] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.769599] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dcf9f05-2312-463f-a10f-331dffd06aeb" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.769725] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.769857] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.769927] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.770041] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db36d30-53f7-47b0-ac61-28873c168bb5" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.770168] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.770303] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.770373] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.770478] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8914f4ea-4ed1-4101-ab21-2b15a1da5534" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.770600] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.770733] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.770806] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.770906] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b841c0a-397f-4e9d-b02d-5feeaebf26a7" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.801504] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.801764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.801764] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.801907] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.801996] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.802128] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7b78e3-6775-4a75-a625-09d47728d125" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.884090] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.884339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.884339] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.884547] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.884631] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.884749] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ee6965-6080-4005-80bf-0264af4bd437" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.894970] env[65973]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1534.895527] env[65973]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65973) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.895675] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.895744] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.895946] env[65973]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.896043] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.896160] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf87a61-c07f-4a06-b6bc-89ada25f6a9e" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.778629] env[65973]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 in Status: SUCCESS [ 1535.778940] env[65973]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea9594c-9374-41a0-a792-b1cfad2ca4a9 deletion is rescheduled due to dependency. [ 1535.778940] env[65973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea9594c-9374-41a0-a792-b1cfad2ca4a9" {{(pid=65973) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.502851] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.503391] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.503796] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.504295] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.505229] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.505661] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.506063] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.506433] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.507338] env[65973]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.507718] env[65973]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0